Marked-Up Version of Substitute Specification 

This application claims priority to U.S. provisional application No. 60/325,559, 
filed October 1 , 2001 . which is incorporated herein bv reference . 

Cross-reference to Concurrently Filed Applications 

The following U.S. provisional application is incorporated herein bv reference: 
Artificial Intelligence For Use In Cosmetic And Non-Cosmetic Environments. 
Application No. 60/325.561 . filed October 1 . 2001 . The following concurrently filed 
U.S. patent applications are also incorporated herein bv reference: Body Image 
Enhancement. U.S. Patent Application No. 10/024.480: Methods And Systems For 
Predicting And/Or Tracking Changes In External Body Conditions. U.S. Patent 
Application No. 10/024.354: Methods And Systems For Generating A Prognosis. 
U.S. Patent Application No. 10/024.333: Historical Beauty Record. U.S. Patent 
Application No. 10/024.622: Identification And Presentation Of Analogous Beauty 
Case Histories. U.S. Patent Application No. 10/024.332: Interactive Beauty Analysis. 
U.S. Patent Application No. 10/024.481 : Simulation Of An Aesthetic Feature On A 
Facial Image. U.S. Patent Application No. 10/024.353: Beauty Advisory System And 
Method. U.S. Patent Application No. 10/024.496: Virtual Beauty Consultant. U.S. 
Patent Application No. 10/024.620: Calibrating Image Capturing. U.S. Patent 
Application No. 10/024.334: Use Of Artificial Intelligence In Providing Beauty Advice. 
U.S. Patent Application No. 10/024.616: Shop-ln-Shop Website Construction. U.S. 
Patent Application No. 10/024.352: Early Detection Of Beauty Treatment Progress. 
U.S. Patent Application No. 10/024.619: Cosmetic Affinity Indexing. U.S. Patent 
Application No. 10/024.356: Systems And Methods For Providing Beauty Guidance. 
U.S. Patent Application No. 10/024.621: Methods And Systems Involving Simulated 
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Application Of Beauty Products. U.S. Patent Application No. 10/024,355; 
Customized Beauty Tracking Kit, U.S. Patent Application No. 10/024.351; Analysis 
Using Three-Dimensional Facial Image, U.S. Patent Application No. 10/024,615; 
Body Image Templates With Pre-Applied Beauty Products, U.S. Patent Application 
No. 10/024,482; and Image Capture Method. U.S. Patent Application No. 
10/024,651. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[001] The invention relates to methods, combinations, apparatuses, and 
systems for conducting beauty analyses. The invention also relates to methods, 
combinations, apparatuses, and systems for capturing an image. In one example, 
the invention may integrate the use of image capture and on-line diagnostics. 

Description of Related Art 

[002] Although the invention, in its broadest sense, is not limited to beauty 
products, this patent uses the beauty product example for purposes of conveying to 
the reader some of the principles of the invention. 

[003] Typically, highly personalized beauty attention is available through 
beauty facilities. Such facilities may include spas, salons, and specialized sales 
establishments. A benefit of using such facilities is that it allows professionals to test 
and view first-hand a subject's external body condition. Dermatologist, 
cosmetologist, skin/hair expert, or other reliable professionals have experience 
and/or quantitative tools to help a subject select appropriate beauty products. 



2 



Marked-Up Copy of Substitute Specification 

[004] With the advent of the Internet, has come a large number of portals 
selling beauty products and offering beauty advice. However, the advice tends to be 
generalized in the absence of hands-on testing and observation of the subject. 
Indeed, heretofor, personalized-quantitative analysis may not have been considered 
compatible with electronic channels of commerce. 

SUMMARY OF A FEW ASPECTS OF THE INVENTION 

[005] Disclosed in this patent are various mechanisms for enhancing the 
quality of beauty assistance attainable at locations which may be remote from 
conventional testing and analysis facilities. 

[006] One exemplary aspect of the present invention may involve a method 
for facilitating analysis of an external body condition. The method may include 
offering to provide an analysis of at least one external body condition. A request for 
the analysis may then be received from a requestor. The requestor may then be 
provided with access to a computer program for transmitting an image of the 
external body condition. A transmitted image of the external body received from the 
requestor may be evaluated, and the requestor may be provided with information 
from the evaluation. 

[007] A second exemplary method of facilitating analysis may further include 
providing the requestor with a package for facilitating the analysis, the package 
including an image capture device for recording an image of the external body 
condition. The package also may include various testing materials. 
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[008] An exemplary method of calibrating image capturing may include 
capturing a calibrating image of a body part adjacent a reference image using an 
image capture device. Calibration information may be generated by processing the 
calibrating image and information reflective of the reference image. The image 
capture device and/or a driver for the device may then be calibrated using the 
calibration information. 

[009] An exemplary method of facilitating capture of a body part image may 
include instructing a subject to position the subject's body part (e.g., face) adjacent 
an image capture device (e.g., in the field of capture of the image capture device). A 
first image of the subject's face may be captured using the image capture device 
and then processed. Processing may include calculating at least an approximate 
first position. Further, the calculated first position may be compared with a desired 
reference position, after which, the subject may be instructed to move the subject's 
body part closer to the desired reference position. A second image of the subject's 
body part may be captured after the subject has moved. 

[01 0] An exemplary method of providing a beauty analysis method may 
include instructing a subject to position a body part adjacent a display device and 
within a field of capture of an image capture device. A signal may be sent to the 
display device to generate light in a predetermined wave length range for irradiating 
the body part. An image of the body part may be captured with the image capture 
device while the body part is irradiated with the light emitted from the display device. 
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[01 1] Another aspect relates to systems for performing at least portions of 
one or more of the methods. 

[012] A further aspect relates to a combination including at least one tool for 
gathering beauty related information, an image capture device and a driver for 
driving the image capture device. 

[01 3] The foregoing section is intended to provide the reader with a flavor of 
a few aspects of the invention. Therefore it is to be understood that both the 
foregoing description and the following detailed description are exemplary and 
explanatory only and are not restrictive of the invention as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[014] The accompanying drawings, which are incorporated in and constitute 
a part of this specification, illustrate several aspects of the invention and, together 
with the description, serve to explain the principles of the invention. In the drawings, 

[01 5] Figure 1 illustrates a flow chart of an exemplary method for performing 
a beauty analysis consistent with the present invention; 

[01 6] Figure 2 illustrates another flow chart of an exemplary method for 
performing a beauty analysis consistent with the present invention; 

[01 7] Figure 3 illustrates a flow chart of an exemplary method for calibrating 
image capturing consistent with the present invention; 
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[01 8] Figures 4a and 4b illustrate exemplary reference images for calibrating 
image capturing consistent with features and principles of the present invention; 

[019] Figure 4c illustrates an image of a body part being captured together 
with the reference image of Figure 4A, consistent with the invention. 

[020] Figure 5 illustrates another exemplary reference image for calibrating 
image capturing consistent with the present invention; 

[021] Figure 6 illustrates an exemplary method for processing an image of a 
body part consistent with features and principles of the present invention; 

[022] Figure 7 illustrates a flow chart of an exemplary method for facilitating 
capture of a body part image consistent with the present invention; 

[023] Figures 8A and 8B graphically illustrate aspects of an exemplary 
method for processing a subject's captured image consistent with the present 
invention; 

[024] Figure 9A and 9B graphically illustrate aspects of another method for 
processing a subject's captured image consistent with the present invention; 

[025] Figure 10 illustrates an exemplary system for comparing a position of 
the subject's image relative to a desired reference position consistent with the 
present invention; 

[026] Figure 1 1 illustrates a flow chart of an exemplary method for providing 
a beauty analysis consistent with the present invention; 
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[027] Figure 1 2 illustrates an example of a combination in the form of a 
customized diagnostic kit consistent with features and principle of the present 
invention; and 

[028] Figure 1 3 illustrates an exemplary system environment consistent with 
features and principles of the present invention. 

DESCRIPTION OF EXEMPLARY EMBODIMENTS 

[0291 To the extent not inconsistent with the invention defined herein, 
definitions and terminology usage in the above-mentioned concurrently filed 
applications, the above-mentioned priority application, and the following global 
definitions are to be considered in interpreting the language of this patent and the 
claims herein. Where multiple definitions are provided, they should be considered 
as a single cumulative definition. 

r0301 The term "image" may include one or more of two-dimensional and 
three-dimensional representations. In certain examples consistent with the 
invention, a plurality of images from different perspectives may be used to construct 
a three-dimensional image. In a broader sense, only a single image may be used. 
Depending on the embodiment, the term "image" may include either a visually 
perceptible image or electronic image data that may be either used to construct a 
visually perceptible image or to derive information about the subject. The image 
may be a body image corresponding to an anatomical portion of the subject, and 
may represent, for example, the subject's entire face, or a portion of the subject's 
face. The image may be a detailed picture (e.g., a digital image or a photograph) of 
a portion of the subject's body and/or a topological plot mapping contours of a 
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portion of subject's body. If the image is representative of an external body 
condition, the image could be either an actual image showing the condition or an 
image including symbolizations of the condition, for example. The image may be an 
actual or a simulated image. Simulated images may include wholly or partially 
generated computer images, images based on existing images, and images based 
on stored features of a subject. 

["0311 The term "image capture device", similar terms, and terms 
representing structures with similar functions may include one or more of a digital 
camera, webcam, film camera, analog camera, digital video camera, scanner, 
facsimile machine, copy machine, infrared imager, ultra-sound imaging device, or 
any other mechanism for acguiring an image of a subject's external body condition, 
an image of the subject's countenance, an/or an image of the subject's skin. An 
ultrasonic device might provide skin thickness information, or it might create a map 
on an area of the external location. Thus, the term "image" as used herein may be 
broader than a picture. Combinations of image capture devices may be used. For 
example, an image captured on photographic paper using a film camera might then 
be scanned on a flat bed scanner to create another image. 

[0321 The term "capturing (an image)", or any form thereof, refers to the use 
of an image capture device to acguire an image. "Capturing" may refer to the direct 
act of using the image capture device to acguire the image. It may also include 
indirect acts to promote acguisition. To this end, "capturing" may include the indirect 
acts of providing access to hardware, or to at least one of a client-based algorithm 
and a server-based algorithm for causing the image capture device to capture an 
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image. This may be accomplished by providing a user with software to aid in the 
image capture process, or providing the user with access to a network location at 
which the software resides. Also consistent with certain embodiments of the 
invention, capturing may include at least one of receiving an instruction from the 
subject to capture an image, indicating to the subject before the image is captured, 
and indicating to the subject when the image is captured. 

[0331 The term "image processing technigue" or similar terms, may include a 
software program, computer, application specific integrated circuit, electronic device 
and/or a processor designed to identify in an image one or more characteristics, 
such as a skin condition. Such technigues may involve binarization, image 
partitioning, Fourier transforms, fast Fourier transforms (FFTs), and/or discrete 
cosine transforms may be performed on all or part of the image, resulting in 
coefficients. Based on the coefficients, conditions may be located, as known in the 
art. Artificial intelligence, such as fuzzy logic, neural networks, genetic programming 
and decision tree programming, may also be used to identify conditions. 
Alternatively, one or more digital filters may be passed through the image for 
locating specific conditions. These examples are provided for illustrative purposes 
with the understanding that any image processing technigue may be used. 

[0341 The term "network interface" or similar terms, refer to any mechanism 
for aiding communications between various nodes or locations in a network. A 
network interface may include, for example a bus, a modem, or any other 
input/output structure. A network interface may permit a connection to any network 
capable of being connected to an input and/or output module located within at least 
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one or more of the following exemplary networks: an Ethernet network, an Internet 
Protocol network, a telephone network, a radio network, a cellular network, or any 
mechanism for permitting communication between two or more modes or remote 
locations. In some invention embodiments, a network interface might also included 
a user interface. 

[0351 The term "user interface" may include at least one component such as 
a keyboard, key pad, mouse, track ball, telephone, scanner, microphone, touch 
screen, web cam, interactive voice response system (1VR), voice recognition system 
or any other suitable input mechanism for conveying information. A user interface 
may also include an input port connected by a wired, optical, or wireless connection 
for electromagnetic transmissions. In some embodiments, a user interface may 
include connections to other computer systems to receive the input commands and 
data therefrom. User interface may further include a data reading device such as a 
disk drive for receiving input data from and writing data to storage media such as 
magnetic and optical disks. 

[0361 As used herein terms such as "external body condition", "skin 
condition", and "actual condition" refer to conditions of at least one of the skin, teeth, 
hair, eyebrows, eyelashes, body hair, facial hair, fingernails, and/or toenails, or any 
other externality. Examples of skin conditions may include elasticity, dryness, 
cellulitis, sweating, aging, wrinkles, melanoma, exfoliation, desquamation, 
homogeneity of color, creases, liver spots, clarity, lines, micro-circulation, shininess, 
softness, smoothness, tone, texture, matittv, hydration, sag, suppleness, stress, 
springiness, firmness, sebum production, cleanliness, translucencv, luminosity, 
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irritation, redness, vasocolation. vasomotion, vasodilation, vasoconstriction, 
pigmentation, freckles, blemishes, oiliness, pore distribution, pore size, moles, 
birthmarks, acne, blackheads, whiteheads, pockmarks, warts, pustules, boils, 
blisters, marks, smudges, specks, psoriasis and other characteristics associated 
with the subject's skin. Examples of hair conditions may include keratin plug, length, 
dryness, oiliness, dandruff, pigmentation, thickness, density, root conditions, split 
ends, hair loss, hair thinning, scales, staging, cleanliness and other properties 
related to the subject's hair. Examples of fingernail and toenail conditions may 
include onychomycosis, split nails, delaminating, psoriasis, brilliancy, lines, spots, 
coloration, gloss, strength, brittleness, thickness, hangnail, length, disease, and 
other characteristics related to the subject's nails. Other conditions may include, for 
example, size and proportion of facial features, teeth discoloration, and any other 
aesthetic-related or physical, physiological, or biological conditions of the user. 

[0371 "Enabling", "facilitating", and "causing" an action refer to one or more of 
a direct act of performing the action, and any indirect act of encouraging or being an 
accessory to the action. Thus, the terms include partnering or cooperating with an 
entity who performs the action and/or referring commerce to or having commerce 
referred from an entity who performs the action. Other examples of indirect activity 
encompassed within the definitions of "enabling", "facilitating", and "causing" may 
include providing a subject with one or more of tools to knowingly aid in performing 
the action, providing instructions on how to perform the action, providing prompts or 
cues to perform the action, or expressly encouraging performance of the action. 
Indirect activity may also include cooperating with an entity who either directly 
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performs the action or who helps another perform the action. Tools may include 
software, hardware, or access (either directly, through hyperlink, or some other type 
of cooperation or partnering) to a network location (e.g., web site) providing tools to 
aid in performing the action. Thus, phrases such as "enabling access" and "enabling 
display" do not necessary reguire that the actor actually access or display anything. 
For example, the actor may perform the enabling function by affiliating with an entity 
who performs the action, or by providing instructions, tools, or encouragement for 
another to do the accessing and displaying. 

[0381 Forms of the word "displaying" and like terms may also include indirect 
acts such as providing content for transmission over a network to a display device, 
regardless of whether the display device is in the custody or control of the sender. 
Any entity in a chain of delivering information for display performs an act of 
"displaying", as the term is used herein. 

[0391 Likewise, the term "providing" includes direct and indirect activities. 
For example, providing access to a computer program may include at least one of 
providing access over a network to the computer program, and creating or 
distributing to the subject a computer program configured to run on the subject's 
workstation or computer. For example, a first party may direct network traffic to 
(either through electronic links or through encouragement to visit) a server or web 
site run by a second party. If the second party maintains a particular piece of 
software thereon, then it is to be understood that within the meaning of "providing 
access" as used herein, the first party is said to provide access to the particular 
software. Or if the first party directs a subject to a second party who in turn ships the 
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particular software to the user, the first party is said to provide the user with access 
to the particular software. (Of course, in both of the above instances, the second 
party would also be providing access within the meaning of the phrase as used 
herein.) "Receiving" may include at least one of acguisition via a network, via 
verbally communication, via electronic transmission, via telephone transmission, in 
hard-copy form, or through any other mechanism enabling reception. In addition, 
"receiving" may occur either directly or indirectly. For example, receipt may occur 
through a third party acting on another party's behalf, as an agent of another, or in 
concert with another. Regardless, all such indirect and direct actions are intended to 
be covered by the term "receiving" as used herein. A received reguest, for example, 
may take one of many forms. It may simply be a checked box, clicked button, 
submitted form or oral affirmation. Or it might be a typed or handwritten textual 
reguest. Receiving may occur through an on-line interest form, e-mail, facsimile, 
telephone, interactive voice response system, or file transfer protocol transmitted 
electronically over a network at a web site, an internet protocol address, or a 
network account. A reguest may be received from a subject for whom information is 
sought, or an entity acting on the subject's behalf. "Receiving" may involve receipt 
directly or indirectly through one or more networks and/or storage mediums. Receipt 
may occur physically such as in hard copy form, via mail delivery or other courier 
delivery. 

f0401 Forms of the word "maintain" are used broadly to include gathering, 
storing, accessing, providing access to, or making something available for access. 



13 



Marked-Up Copy of Substitute Specification 

either directly or indirectly. For example, those who maintain information include 
entities who provide a link to a site of a third party where the information is stored, 

[041 1 Consistent with the concepts set forth above, all other recited actions 
such as, for example, obtaining, determining, generating, selecting, applying, 
simulating, presenting, etc, are inclusive of direct and indirect actions. Thus, for 
purposes of interpreting the following claims, an entity performs a recited action 
through either direct or indirect activity. Further examples of indirect activity include 
sending signals, providing software, providing instructions, cooperating with an entity 
to have the entity perform the action, outsourcing direct or indirect actions, or serving 
in any way as an accessory to the specified action. 

T0421 The term "product" is used to genericallv refer to tangible merchandise, 
goods, services, and actions performed. A "beauty product," "beauty care product," 
"cosmetic product" or similar terms, refer to products (as defined above) for effecting 
one or more external body conditions, such as conditions of the skin, hair and nails. 
Examples of tangible merchandise forms of beauty products include cosmetic 
goods, such as treatment products, personal cleansing products, and makeup 
products, in any form (e.g., ointments, creams, gels, sprays, supplement, ingesta, 
inhalants, lotions, cakes, liguids, and powders.) 

[0431 Examples of services forms of beauty products include hair styling, hair 
cutting, hair coloring, hair removal, skin treatment, make-up application, and any 
other offering for aesthetic enhancement. Examples of other actions performed 
include massages, facial rubs, deep cleansings, applications of beauty product, 
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exercise, therapy, or any other action effecting the external body condition whether 
performed by a professional, the subject, or an acquaintance of the subject. 

[0441 The following is exemplary and non-exhaustive listing of a few beauty 
products- scrubs, rinses, washes, moisturizers, wrinkle removers, exfoliates, toners, 
cleansers, conditioners, shampoos, cuticle creams, oils, and anti-fungal substances, 
anti-aging products, anti-wrinkle products, anti-freckle products, skin conditioners, 
skin toners, skin coloring agents, tanners, bronzers, skin lighteners, hair coloring, 
hair cleansing, hair styling, elasticity enhancing products, agents, blushes, 
mascaras, eyeliners, lip liners, lipsticks, lip glosses, eyebrow liners, eve shadows, 
nail polishes, foundations, concealers, dental whitening products, cellulite reduction 
products, hair straighteners and curlers, and weight reduction products. A beauty 
care treatment regimen may involve the administration of one or more products, as 
defined above. 

T0451 The terms "beauty advice", "beauty guidance", and similar terms are 
used interchangeably to refer to the provision of beauty related information to a 
subject. Advice or guidance includes one or more of beauty product 
recommendations (e.g., cosmetic product recommendations for products to treat 
conditions the subject is prompted to evaluate), remedial measures, preventative 
measures, predictions, prognoses, price and availability information, application and 
use information, suggestions for complementary products, lifestyle or dietary 
recommendations, or any other information intended to aid a subject in a course of 
future conduct, to aid a subject in understanding past occurrences, to reflect 
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information about some future occurrences related to the subject's beauty or to aid a 
subject in understanding beauty products, as defined above. 

[0461 The term "network" may include a public network such as the Internet 
or a telephony network, a private network, a virtual private network, or any other 
mechanism for enabling communication between two or more nodes or locations. 
The network may include one or more of wired and wireless connections. Wireless 
communications may include radio transmission via the airwaves, however, those of 
ordinary skill in the art will appreciate that various other communication technigues 
can be used to provide wireless transmission including infrared line of sight, cellular, 
microwave, satellite, blue-tooth packet radio and spread spectrum radio. Wireless 
data may include, but is not limited to, paging, text messaging, e-mail, Internet 
access and other specialized data applications specifically excluding or including 
voice transmission. 

r0471 In some instances consistent with the invention, a network may include 
a courier network (e.g. postal service, United Parcel Service, Federal Express, etc.). 
Other types of networks that are to be considered within the scope of the invention 
include local area networks, metropolitan area networks, wide area networks, ad hoc 
networks, or any mechanism for facilitating communication between two nodes or 
remote locations. 

[0481 "Artificial intelligence" (Al) is used herein to broadly describe any 
computationally intelligent systems that combine knowledge, technigues, and 
methodologies. An Al engine may be any system configured to apply knowledge 
and that can adapt itself and learn to do better in changing environments. Thus, the 
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Al engine may employ any one or combination of the following computational 
technigues: neural network, constraint program, fuzzy logic, classification, 
conventional artificial intelligence, symbolic manipulation, fuzzy set theory, 
evolutionary computation, cybernetics, data mining, approximate reasoning, 
derivative-free optimization, decision trees, or soft computing. Employing any 
computationally intelligent technigues, the Al engine may learn to adapt to unknown 
or changing environment for better performance. Al engines may be implemented or 
provided with a wide variety of components or systems, including one or more of the 
following: central processing units, co-processors, memories, registers, or other 
data processing devices and subsystems. 

f0491 Al engines may be trained based on input such as product information, 
expert advice, user profile, or data based on sensory perceptions. Using input an Al 
engine may implement an iterative training process. Training may be based on a 
wide variety of learning rules or training algorithms. For example, the learning rules 
may include one or more of the following: back-propagation, real-time recurrent 
learning, pattern-bv-pattern learning, supervised learning, interpolation, weighted 
sum, reinforced learning, temporal difference learning, unsupervised learning, or 
recording learning. As a result of the training, Al engine may learn to modify its 
behavior in response to its environment, and obtain knowledge. Knowledge may 
represent any information upon which Al engine may determine an appropriate 
response to new data or situations. Knowledge may represent, for example, 
relationship information between two or more products. Knowledge may be stored 
in any form at any convenient location, such as a database. 
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f05Q1 Since Al engine may learn to modify its behavior, information 
describing relationships for a universe of all combinations of products may not need 
to be maintained by the Al engine or any other component of the system. 

f0511 "Personal information", "subject specific information", "user specific 
information", "user profile", "personal characteristics", "personal attributes", "profile 
information", and like terms (collectively referred to in this section as "personal 
information") may broadly encompass any information about the subject or user. 
Such information may, for example, fall within categories such as physical 
characteristics, fashion preferences, demographics, nutritional information, cosmetic 
usage information, medical history information, environmental information, beauty 
product usage information, lifestyle, and may include information such as name; 
age; birth date; height; weight; ethnicity; eating habits; vacation patterns; geographic 
location of the individual's residence, location, or work; work habits; sleep habits; 
toiletries used; exercise habits; relaxation habits; beauty care habits; smoking and 
drinking habits; sun exposure habits; use of sunscreen; propensity to tan; number of 
sunburns and serious sunburns; dietary restrictions; dietary supplements or vitamins 
used; diagnosed conditions affecting the external body, such as melanoma; an 
image, such as a picture or a multimedia file of the subject; facial feature 
characteristics; family history information such as physical characteristics 
information about relatives of the subject (e.g., premature balding, graving, wrinkles, 
etc.); external body condition (as defined previously); color preferences, clothing 
style preferences, travel habits; entertainment preferences; fitness information; 
adverse reactions to products, compounds, or elements (e.g., sun exposure); body 
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chemistry, use of prior beauty care products and their effectiveness; purchasing, 
shopping, and browsing habits; hobbies; marital status; whether the subject is a 
parent; country of residence; region of residence; birth country and region; religious 
affiliation; political affiliation; whether the subject is an urban dweller suburban 
dweller or rural area dweller; size of urban area in which the subject lives; whether 
the subject is retired; annual income, sexual preference, or any other information 
reflecting habits, preferences, or affiliations of the subject. 

[0521 Personal information may also include information electronically 
gleaned by tracking the subject's electronic browsing or purchasing habits, or as the 
result of cookies maintained on the subject's computer, responses to surveys, or any 
other mechanism providing information related to the subject. In addition, personal 
information may be gathered through non-electronic mechanisms such as hard copy 
surveys, personal interviews, or consumer preference polls, 

[0531 "Complementary" and "complementary product" refers to one or more 
of physical, physiological, biologically, and aesthetic compatibility. A product may be 
complementary with one or more of another product, a group of products, or a 
subject. In that latter instance, whether a product is considered "complementary" 
may be a function of personal information of the subject. Thus, for example a 
product may be complementary if it is unlikely to cause an adverse allergic reaction; 
if it physically blends well with another product; or if it is aesthetically consistent with 
the subject or one or more other products. Aesthetic compatibly may refer to the 
fact that two products are aesthetically appealing (or do not clash) when worn 
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together. The identification of a complementary product may also be based on 
product characteristics, user preferences, survey data, or expert advice. 

f0541 As used herein, the words "may" and "may be" are to be interpreted in 
an open-ended, non- restrictive manner. At minimum, "may" and "may be" are to be 
interpreted as definitively including structure or acts recited. Further, the word "or" is 
to be interpreted in the conjunctive and the disjunctive. 

fQgMOSSI Reference is now made in detail to exemplary embodiments of 
the invention, examples of which are illustrated in the accompanying drawings. 
Wherever possible, the same reference numbers are used throughout the drawings 
to refer to the same or like parts. 

{030J[056]__One embodiment of the invention may include a method for 
facilitating analysis of an external body condition. Facilitating may occur, for 
example, by offering information or guidance to the customer so that the customer is 
encouraged to participate in an analysis of an external body condition. Such 
encouragement might also occur by providing a subject with a promotional item or a 
complementary service, as is discussed later in greater detail. An analysis might 
involve examination of body conditions such as skin texture, skin elasticity, skin or 
hair dryness, cellulitis, sweating, aging, wrinkles, melanoma, exfoliation, 
desquamation, homogeneity of skin or hair color, micro-circulation, skin or hair 
shininess, skin or hair softness, skin or hair smoothness, hydration, sebum 
production, skin or hair cleanliness, irritation, redness, vasomotion, vasodilation, 
vasoconstriction, pigmentation, freckles, baldness, thinning hair, size and proportion 
of facial features, or any other visible external body condition. 



20 



Marked-Up Copy of Substitute Specification 

fQ344f0571 Consistent with the invention, a method may include offering to 
provide an analysis of at least one external body condition. This is shown as block 
102 in the flow chart of Figure 1 . The offer may be in written or oral form, and may 
include providing at least one of an express offer, an implied offer, a direct offer, and 
an indirect offer. The offer may be embodied in any type of information, promotion, 
or solicitation that refers to the analysis. Further, a first party may operate alone or 
in cooperation with a third party vendor to provide the offer. For example, text on a 
web page might directly invite a subject to seek an analysis from the web hoster. Or 
similar text may indirectly offer an analysis to be performed by a third party. 

fQ3gtr0581 Offers may be made through electronic advertisements or 
printed media. Electronic advertisements may be transmitted by e-mail or facsimile 
over a network, transmitted physically or electronically by software configured to run 
on the recipient's computer, or embedded in various websites, including pop-up 
advertisements or Internet links that direct an individual to a third party website. 
Printed media containing an offer may be distributed by mail, facsimile, flyers, 
magazines, or simply displayed as advertisements within or outside a store. In 
addition, sales representatives may discuss the offer face-to-face with potential 
customers, or telemarketers or automated telephone dialing services may call 
potential customers to discuss the offer or provide pre-recorded voice message 
advertisements. 

fQ33ir0591 Consistent with the invention, a method may include receiving a 
request for the analysis, as graphically depicted at block 1 04 in Figure 1 . The term 
"receiving" as used throughout this patent may include at least one of receiving a 
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request over a network, receiving a request verbally, receiving a request 
electronically, receiving a request telephonically, receiving a request in hard-copy 
form, or receiving a request through any other mechanism enabling reception. In 
addition, "receiving" may occur either directly or indirectly. For example, receipt may 
occur through a third party acting on another party's behalf, as an agent of another, 
or in concert with another. Regardless, all such indirect and direct actions are 
intended to be covered by the term "receiving" as used herein. 

fO34J[060]_The received request may take one of many forms. It may be 
written, oral, or electronic. It may simply be a checked box, clicked button, 
submitted form or oral affirmation. Or it might be a typed or handwritten textual 
request. 

fQ35tt061 1 Receiving may occur through an on-line interest form, e-mail, 
facsimile, telephone, interactive voice response system, or file transfer protocol 
transmitted electronically over a network at a website, an internet protocol address, 
or a network account. A request may be received from a subject for whom the 
analysis is to be conducted, or an entity acting on the subject's behalf. 

fQ3ejf0621 A network used with some embodiments of the invention may 
include local area networks, wide area networks, metropolitan area networks, or any 
other type of network suitable for interfacing a host website with the subject's 
workstation. The network may include one or more of wired and wireless 
connections. The network may also include a combination of public (e.g., Internet) 
and private networks, as well as virtual private networks. In a broader sense, a 
network may include any mechanism for facilitating communication between two 
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nodes or remote locations. One of ordinary skill in the art can readily appreciate that 
any number of geographically dispersed workstations may connect to the network 
and couple with a host website. 

fQ374r0631 Printed media may be received in hard-copy form. Similarly, a 
subject may respond orally to an offer during a telephone call. The requestor may 
talk to an operator, press a keypad on the telephone in response to prompts, or 
leave a voice message to request the analysis. In addition, the subject may accept 
a face-to-face offer from a sales representative. The received request may include 
an indication of acceptance of the offer, as well as other personal information, such 
as a name and mailing address of a subject or the requestor. 

f0384f0641 C onsistent with the invention, a method may include providing a 
package for facilitating the analysis, the package including an image capture device 
for recording an image of the external body condition. This is graphically illustrated 
at block 1 06 in Figure 1 . Facilitating may occur by virtue of the fact that material 
contained in the package is to be used for carrying out at least a portion of the 
analysis. To this end, and according to one aspect of the invention, the only 
substantive item contained in the package may be an image capture device, 

fQ39¥0651 "Providing," as used throughout this patent, includes direct and 
indirect activities. Thus, an entity who hires, works with, or cooperates with another 
to convey a package, performs the act of providing, despite the indirect nature of the 
entity's conduct. As used herein, an "image capture device" may include a web 
camera, an analog camera, a digital camera, a flat bed scanner, a film scanner, 
ultra-sound imaging device or any other device suitable for capturing an image of the 
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subject. The package may be provided to the subject by courier or any other 
package delivery service. A first party may operate alone or in cooperation with a 
third party vendor to provide the requestor with the package. The package may also 
include a driver for driving the image capture device. 

fQ4Qlf0661 Consistent with the invention, the image capture device may be 
provided to the requestor free of charge. In this manner, the image capture device 
may serve as an interactive marketing tool for engaging the subject. Alternatively, 
the package may be offered at a fair market value or at a discounted value. 

fQ444f0671 While the image capture device may be usable by the subject 
for a variety of purposes, at least one intended purpose in connection with the 
invention is to capture an image of an external body condition. To this end, the 
package might include instructions to the user on how to perform body image 
capture. The instructions might be in hard copy or electronic form, and may be 
transmitted with or separated from the image capture device. 

fQ4gJ[0681 T he package also may (or may not) include an evaluation tool 
for analyzing an external body condition. The evaluation tool may include at least 
one of a pH indicator, a sebutape, a d-squame disc and a corneodisque indicator. 
The subject may use a pH indicator, according to the electronic or hard-copy 
instructions, to test a pH value of the skin and/or scalp. Similarly, the subject may 
use sebutape to remove sebum and other liquids, such as lipids, from the surface of 
the skin or scalp, thereby indicating skin oiliness, and a d-squame discs to remove 
flakes from the surface of the skin or scalp, thereby indicating skin dryness. A 
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corneodisque indicator may leech water from the surface of the epidermis, thereby 
indicating the moisture/humidity content of at least the epidermis portion of the skin. 

{Q43TO691 Other tests of varying cost and scope may also be provided in 
the package. For example, test materials may include a device to measure skin 
elasticity. Similarly, test materials may include hormone tests, enzymatic tests, or 
any other measurement reflective of an external body condition. Test materials may 
also include various color charts (in hard or soft form), which a subject may use to 
compare with an external body condition. For example, the subject may use such 
charts to determine a skin or hair tone, skin or hair color, amount and intensity of 
wrinkles, acne, balding, hairiness, and/or freckles by selecting the chart that most 
closely represents an external condition of the subject. Skin roughness may be may 
be judged using tactile test materials as a reference against which skin texture may 
be determined. Similar tactile test materials may be used for hair and skin texture 
and color. The comparison may be completed after applying a particular product to 
the skin to increase effectiveness. In addition, test materials may include materials 
for the subject to compare with a texture of the skin to determine a roughness level 
of the skin. 

fQ444[0701 If the package includes multiple items, all items may be 
transmitted as a group. Alternatively, the package may include multiple parcels 
transmitted at the same or separate times. The package may include, for example, 
materials received by the subject in person at a retail establishment and materials 
later received by courier. 
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fQ45¥0711 T he test materials may include a voucher for having one or 
more tests conducted at a testing facility. Directions may be provided on how to 
conduct a self-test (either alone or with the aid of an acquaintance) and may further 
include instructions on how to interpret results of the self-test. Alternatively, the 
directions might include information on how to go about transmitting used self-testing 
materials to a vendor for analysis. To that end, a voucher or other authorization 
mechanism may be provided as part of the package, for transmission to the vendor. 

fQ4§¥0721 In lieu of one or more self-testing materials, the included 
voucher or authorizing mechanism might cover a face-to-face analysis in a testing 
facility. In that case, the subject might be advised of a nearby testing facility where 
the voucher may be redeemed in person. The testing facility may use at least one of 
a corneometer for measuring a water content of subject's scalp or skin, a cutometer 
for measuring skin elasticity, a melameter for measuring a melanin index and 
hemoglobin (erythema) index of skin, a sebumeter for measuring sebum content of 
scalp or skin, skin-pH meter for measuring pH of skin or scalp, skin visiometer for 
measuring skin roughness, sun protection diagnostic to perform an SPF analysis, 
tewameterto measure trans-epidermal water loss, visioscan to evaluate the skin 
surface, chromameter to measure skin clarity or luminosity, impedance 
measurements to measure skin moisture, a gas bearing electrodynamometer to 
measure skin softness and suppleness, skin replicas or image analysis to measure 
skin surface smoothness or texture, TEWL to measure skin barrier function, laser 
doppler to measure blood flow or skin sensitivity, ultrasound to measure skin and 
fatty tissue thickness, lesion counting and bacteriology to study acne, and 
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ballestometry to measure skin firmness. Hair moisture and suppleness, hair tensile 
strength, penetration of actives into hair, hair deposition, and UV protection may also 
be determined. The tests and test materials described above are not intended to be 
inclusive, it being understood that tests and test materials, as used herein, are 
intended to cover any method and product for evaluating an external body condition. 

fQ471f0731 Consistent with the invention, a method may include providing 
instructions on how to use the image capture device to record an image of the 
external body condition, as graphically shown at block 108 in Figure 1 . The 
instructions may be provided electronically, telephonically, verbally, via software or 
in hard copy form. Further, they may be provided directly or indirectly as discussed 
earlier. The instructions may be provided electronically at a website, which the 
subject may access over a network, or they may be transmitted over a network 
electronically through e-mail or by file transfer protocol. In addition, the subject may 
receive software configured to run on the subject's computer for providing the 
instructions electronically. 

fQ43ir0741 T he instructions may include information on how to connect the 
image capture device to a computer. For example, the instructions may explain how 
to connect the image capture device to at least one of a universal serial bus (USB), 
a SCSI card for a PCI or ASP port, another dedicated card, and a parallel port of a 
computer. The instructions may also contain information regarding when, where, 
and how to use the image capture device. For example, the instructions may 
suggest using the image capture device at a particular time of the day for lighting 
purposes, or in a darkened room with a particular light source. The instructions 
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might also suggest use of the image capture device only after a prescribed amount 
of time following cleansing or application of certain other beauty products. For 
example, the instruction may suggest waiting several hours after cleansing and/or 
applying any beauty products before using the image capture device. In addition, 
the instructions may direct where to stand in relation to the camera and how to 
position the image capture device. 

fQ491K)751 Consistent with the invention, a method may include providing 
instructions on how to transmit a recorded image of the external body condition to an 
evaluation location. This is graphically illustrated at block 1 10 in Figure 1 . These 
instructions may be transmitted in a manner similar to that, described previously, in 
connection with instructions for using the image capture device. The instructions 
may direct the user on how to transmit an image over a network such as the 
Internet. Alternatively, the instructions may direct the user to save the recorded 
image on a storage medium and physically transmit the storage medium to a 
designated location. Examples of storage medium may include magnetic storage 
devices, such as floppy disks, Iomega zip disks, and tapes, optical storage devices, 
such as compact discs and digital video discs, organic storage devices, random 
access memory, read only memory, printed media, or any other medium for storing 
information. The instruction might also direct the user to print the recorded image 
and send the printed image by mail or facsimile to a designated location. 

fQ5Qlf0761 By way of yet another example, the user may be instructed to 
provide the recorded image electronically to a client-based algorithm or a server- 
based algorithm. The client-based algorithm may be provided on a storage medium 
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configured to run on the recipient's computer after delivery to the recipient. A 
server-based algorithm may be provided at a location remote from the recipient 
and/or through a third party vendor. The recipient may provide the algorithm to the 
server based algorithm over a network. One of ordinary skill in the art will appreciate 
that a first party may operate alone or in cooperation with a third party vendor to 
instruct the user on how to transmit a recorded image. 

fQ544f0771 Consistent with the invention, a method may include receiving 
the recorded image at the evaluation location, as illustrated in block 1 12 of Figure 1. 
The recorded image may be received electronically, telephonically, in software form, 
or in hard-copy form as described above. Electronic reception may occur at a node 
on a network. Physical reception may occur at a facility associated with persons 
skilled in visually or electronically evaluating images of external body conditions. For 
example, the technician may note shininess depicted in an image of the external 
body condition, indicating an oily skin condition or a technician may note the 
intensity and severity of facial wrinkles. And as discussed previously, receiving may 
occur directly or indirectly. 

fQ§ar0781 Consistent with the invention, a method may include evaluating 
the received image. This is graphically illustrated in block 1 14 of Figure 1 . The term 
"evaluating" may include, but is not limited to, one or more of observing, marking, 
following, recording, graphing, measuring, calculating, projecting, and monitoring the 
image. For example, evaluating may include generating metrics of desirable and 
undesirable conditions in the subject's external body condition. Examples of metrics 
for wrinkles may include average density, extent, intensity, frequency, type and 
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severity (e.g., calculated from wrinkle depths and percentage area). Examples of 
metrics for shininess may include extent, intensity, frequency, type, and severity of 
shininess (e.g., calculated from reflectivity indices). 

fQ531f0791 Image processing techniques and/or software may be used to 
evaluate the external body condition. Techniques for processing images may 
involve binarizing the received image to aid in locating conditions. Binarization may 
increase the contrast of the image to facilitate condition detection. Fourier 
transforms, fast Fourier transforms (FFTs), and/or discrete cosine transforms may 
be performed on all or part of the image, resulting in coefficients. Based on the 
coefficients, conditions may be located, as known in the art. Artificial intelligence, 
such as fuzzy logic, neural networks, genetic programming and decision tree 
programming, may also be used to identify conditions. It is known to persons of 
ordinary skill in the art how to train a neural network to accomplish these functions. 
Alternatively, one or more digital filters may be passed through the image for 
locating specific conditions. These examples are provided for illustrative purposes 
with the understanding that any image processing technique may be used within the 
scope and spirit of the invention. Related image processing examples are provided 
in a concurrently filed application entitled "Feature Extraction in Beauty Analysis" 
(attorney docket no. 5725.0978), the disclosure of which is incorporated herein by 
reference. 

fQ54ir0801 A lso consistent with the invention, a technician or other skilled 
individual may visually examine the image. 
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fQ55J[08n As with the other steps, "evaluating" may be accomplished 
directly or indirectly. An example of indirect evaluating includes partnering with a 
third party who performs the evaluating function. 

fQ561[0821 Consistent with the invention, a method may include providing 
information obtained as a result of evaluating the received image. This is graphically 
depicted in block 1 16 of Figure 1 . "Providing" may occur using mechanisms 
previously described to convey to a subject information learned as a result of 
evaluating. For example, the subject may be advised that she has unusually severe 
wrinkles for her age. The provided information may also advise whether a treatment 
exists for the condition. Further, the information may include identification of a 
recommended product. For example, the method may provide an individual with 
advice regardless of form, suggesting either directly or indirectly to use one or more 
beauty products (e.g., cosmetic substances and/or cosmetic services). Such a 
suggestion may occur in response to a specific request from the individual, or may 
be made in response to collecting individual-specific information provided through 
electronic or physical channels. The prescription may suggest use of a specific 
product(s), class of product(s), and/or a product brand. In addition to product 
recommendations, the prescription may include preventative measures, remedial 
measures, lifestyle or dietary recommendations or any advice or guidance that might 
correlate to a subject. The prescription may or may not contain product application 
and use advice. 

fQCT0831 Another embodiment of the invention, graphically illustrated in a 
flow chart of Figure 2, also depicts a method of facilitating analysis of an external 
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body condition. This embodiment is similar in many respects to the embodiment of 
Figure 1 . However, rather than providing a package including an image capture 
device (block 106 of Figure 1) and instructing the requestor on how to use the image 
capture device (block 108 of Figure 1), the embodiment of Figure 2 may include 
providing access to a computer program for transmitting an image of an external 
body condition (block 206 of Figure 2.) Block 206 Of Figure 2 may be performed 
after offering to provide an analysis of at least one external body condition (block 
202, which is similar to block 102 of Figure 1) and after receiving a request for the 
analysis (block 204, which is similar to block 104 of Figure 1 .) 

fQ5&[f0841 Providing access to a computer program may include at least 
one of providing access over a network to the computer program, and creating or 
distributing to the subject a computer program configured to run on the subject's 
workstation or computer. For example, a first party may host a website or contract 
with a third party vendor to host a website for enabling a user to access the 
computer program over a network. The user may receive the computer program by 
downloading it from a host website, by having it delivered via file transfer protocol 
(FTP), to a workstation local to the recipient, by receiving it as an attachment in an 
e-mail message, or any other mechanism for obtaining a computer program. The 
computer program may be provided on software, hardware, or a combination 
thereof. 

fQ5fflf0851 Access to the computer program may be provided to the subject 
of the analysis. Alternatively, access may be provided to an entity acting on the 
subject's behalf. 
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fQ€QJf0861 Alternatively, a first party and/or third party vendor may enable 
system access by creating or distributing to the subject a floppy disk, tape, compact 
disc, digital video disc, organic storage device, Iomega zip disk, or any other storage 
medium containing a computer program configured to run on the recipient's 
workstation. The recipient's workstation may be embodied within a home computing 
system, may be located in a kiosk or mobile communications device, or may be part 
of a processing system run by professionals in a salon, place of business or retail 
establishment. As embodied herein, the computer program configured to run on 
subject's computer may be delivered to the subject using a courier, Federal Express, 
United Parcel Service, United States Postal Sen/ice, or any other public or private 
delivery service. 

iQ&44f0871 Consistent with the invention, a method also may (or may not) 
include receiving the transmitted image of the external body condition (block 208), 
evaluating the received image (block 210), and providing information obtained as a 
result of evaluation (block 212). Blocks 208, 210, and 212, which are graphically 
depicted in Figure 2, are similar to blocks 1 12, 1 14, and 116, respectively, of Figure 
1. 

fO§2J[088]__As illustrated in a flow chart of Figure 3, another embodiment of 
the invention may also include a method of calibrating image capturing. Consistent 
with the invention, the method may (or may not) include displaying a reference 
image on a calibrated display device. This is illustrated in block 302. "Displaying" 
may include providing access to at least one of a client-based algorithm and a 
server-based algorithm for displaying the reference image. In addition, as used 
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herein, "displaying" includes a direct act of causing display, as well as any indirect 
act that facilitates displaying. Indirect acts include providing software to an end user, 
maintaining a website through which a user is enabled to affect a display, 
hyperlinking to such a website, or cooperating or partnering with an entity who 
performs such direct or indirect acts. Thus, a first party may operate alone or in 
cooperation with a third party vendor to enable the reference signal to be generated 
on a display device. 

fQ63J[0891 T he display device may include any device suitable for 
displaying the reference image, such as a monitor. In one example, the display 
device may be a device which has been calibrated through the use of any 
conventional software intended to be used in evaluating, correcting, and/or 
improving display results (e.g., a color monitor that has been adjusted using monitor 
calibration software). 

fO644r0901 Such calibration techniques are employed, for example, by 
Hewlett Packard and Lexmark printer drivers which account for a transfer from a 
RGB display mode to a CMYK print mode. 

tQ65¥09 1 1 Alternatively (or in addition), a special lighting device (for 
example, a special lighting device located at a salon) could be used to obtain 
information that could then be used to calibrate a display. 

fQ66ir0921 If the display device has been calibrated, precise colors of a 
reference image displayed on the display device may be known. If a body part is 
placed adjacent the known reference image, an image capture device might be used 
to simultaneously capture an image of both the body part and the reference image. 
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A color match might be then be determined. Thereafter, the image capture device 
(or its driver) might be calibrated. 

fQ€7TO931 Rather than (or in addition to) displaying the reference image on 
a display device, a method, consistent with the invention, may include providing a 
reference image to a subject. "Providing" may include creating or distributing the 
reference image to the subject by physical, telephonic, or electronic delivery, 
providing access over a network to the reference, or creating or distributing software 
to the subject configured to run on the subject's workstation or computer including 
the reference image. In one example, the providing of the reference image could 
involve enabling the subject to obtain the reference image in hard copy form via a 
printer. For example, information, software, and/or instructions could be transmitted 
(e.g., electronically or physically via a data storage device or hard copy) and/or 
otherwise made available (e.g., via a network) in order to facilitate the subject using 
a printer to print a hard copy form of reference image. In such an example, the 
printer may be a printer which has been calibrated through the use of any 
conventional software intended to be used in evaluating, correcting, and/or 
improving printing results (e.g., a color printer that has been adjusted using color 
correction software). 

fQ€£[f0941 T he reference image may include a color bar of multiple colors 
and/or a swatch of multiple colors. The multiple colors may represent a range of 
skin tones, skin colors, and/or skin replicas. For example, a range of skin tones or 
skin colors may include a monotonic range of discrete or continuous tones or colors. 
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Figures 4a and 4b graphically illustrate a discrete and a continuous range of colors, 
respectively (depicted in gray scale). 

fQ69K>951 Alternatively, a skin replica may include a range of continuous 
or discrete skin replicas or patterns, each skin pattern including at least one color. 
Skin replicas, in physical form, may include a synthetic swatch that might be 
included, for example, in a test kit. In image form skin replicas may include actual or 
synthesized images of skin. The skin replica or pattern may indicate a predominate 
color or tone of an area of skin, as well as a degree of variation in the skin color or 
tone. Particularly, the skin replica may indicate a level of freckles, moles, hair, age 
spots, blotches, or other skin irregularities. An exemplary skin replica having 
discrete skin patterns for one predominate color is shown in Figure 5. One of 
ordinary skill in the art can readily recognize that, within the scope and spirit of the 
invention, skin patterns may be provided in numerous forms and for numerous tones 
and colors of skins. 

fffZQjr0961 Consistent with the invention, a method may include instructing 
a subject to place a body part adjacent the reference image. This is graphically 
illustrated at block 304 of Figure 3. For example, the subject may be instructed to 
place an arm, hand, face, or other body part adjacent the reference image displayed 
on the display device, as shown in Figure 4c. Figure 4c graphically illustrates 
capturing an image of an arm 406 placed adjacent a reference image 402 displayed 
on display device 408 using web cam 410. 

fQ744f0971 T he instructions may further advise the subject to position the 
body part such that the displayed reference image and the body part may be 
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captured simultaneously by an image capture device. Thus, the term "adjacent" 
includes all positions where the body part and the reference image may be captured 
together by an image capture device. The phrase "instructing the subject" may 
include at least one of transmitting instructions to the subject over a network, 
transmitting instructions to the subject in the form of software, and instructing the 
subject in hard-copy form as detailed above. It also includes providing instructions 
to someone acting on the subject's behalf. A first party may operate alone or in 
cooperation with a third party vendor to instruct the subject. 

fQ72TO981 C onsistent with the invention, a method may include capturing a 
calibrating image of the body part adjacent the reference image using an image 
capture device. This is depicted at block 306 of Figure 3. As used herein, the 
"capturing" could be performed directly (e.g., by operating the image capture device) 
or indirectly (e.g., by enabling and/or facilitating operation of an image capture 
device to obtain the calibrating image). For example, capturing may be performed 
by providing instructions on how to use an image capture device, as discussed 
above. Capturing a calibrating image may include providing access to at least one 
of a client-based algorithm and a server-based algorithm for causing the image 
capture device to capture a calibrating image. Capturing may also include at least 
one of receiving an instruction from the subject to capture a facial image, indicating 
to the subject that the facial image is about to be captured, and indicating to the 
subject when a facial image is captured. In one example, the reference image 
and/or the body part may be spaced away from the image capture device when the 
calibrating image is acquired (e.g., the reference image and/or body part could lack 
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contact with and/or physical connection to the image capture device used to acquire 
the calibrating image). 

fQ731f0991 In one optional example, where the reference is displayed on 
the display device, the display device may be darkened except for the area of the 
reference image, so that excess light from the screen does not interfere with image 
capture calibration. Alternatively, the lighting in the portion of the screen other than 
the reference image could be adjusted to illuminate the body part during image 
capture. 

f074^[01 001 Consistent with the invention, a method may include generating 
calibration information by processing the calibrating image and information reflective 
of the reference image, as shown at block 308 of Figure 3. The phrase "generating 
calibration information" may include performing any type of image processing or 
analysis on the calibrating image and information relating to the reference image, 
which may then be used for creating and/or storing information to calibrate the 
image capture device and/or a driver for the image capture device (e.g, software, a 
processor, and/or any form of hardware associated with the image capture device to 
enable its operation). The generating of calibration information could be performed 
via direct activity (e.g., conducting the calibration generation) or indirect activity (e.g., 
transmitting and/or making available software, an algorithm and/or information 
enabling and/or facilitating calibration information generation). The "information 
reflective of the reference image" may be the reference image itself and/or data 
regarding the reference image (e.g., information indicative of the actual colors and/or 
color distribution in the reference image). 
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fQ75ir010n Generating calibration information may also include comparing 
at least one color of the body part in the calibrating image to at least one known 
color of the reference image. For example, when the reference image comprises a 
monotonic range of skin tones or skin colors, as illustrated in Figures 4a and 4b, the 
calibrating image may be filtered or otherwise processed for determining a 
predominate color prior to the comparison. For example, Figure 6a depicts an 
image of an arm captured as a calibration image. At least a portion of the captured 
image 602, graphically shown in an enlarged view in Figure 6b, may be processed 
using a digital filter or other processing technique, for example, to remove moles, 
freckles, age spots, hair, and other irregularities from the image, thereby determining 
a predominate color or tone 602c, shown in Figure 6c. 

fQ76¥0102l A fter determining the predominate color or tone, the filtered 
calibration image may be compared to at least one known color of the reference 
image. For example, the filtered image 602c shown in Figure 6c may be compared 
to at least one color of the reference image 402, 404, shown in Figures 4a and 4b, 
respectively. Based on the comparison, a color of the reference image that is most 
similar to a color of the calibration image 602c may be stored as calibration 
information in a data base provided at a location local or remote from the subject. 
Since the colors on the color bar are known quantities, a single image of the color 
bar and the skin will enable precise calibration of the image capture device. 
Alternatively, if a color bar or skin replica bar is provided to the subject in physical 
form, the image capture device might capture an image of the color bar on or near 
the skin within the same image. 
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fQ774[01031 When the reference image comprises a range of skin replicas, 
the calibrating image may be compared to a reference image, such as reference 
image 500 of Figure 5, without filtering. In this manner, a skin replica most similar to 
the original calibrating image 602 may be automatically selected and stored in a data 
base as calibration information. 

fQ7&H"01 041 Consistent with the invention, a method may include calibrating 
the image capture device and/or the driver for the image capture device using the 
calibration information. This is graphically shown at block 310 of Figure 3. 
"Calibrating" may include enabling an adjustment on a subsequent captured image 
based upon the calibration information. For example, a color, tone, or skin 
replica/pattern of a subsequent captured image may be adjusted to resemble a 
color, tone, or skin replica/pattern that is stored as calibration information. In this 
way, an accurate image of the subject's external body condition may be displayed 
on the display device, even under varying lighting conditions, for example. As with 
other aspects of the methods described herein, the calibrating could involve direct 
activity or indirect activity (e.g., providing and/or making available an algorithm, 
software and/or information enabling and/or facilitating the calibrating). 

fQ79¥01 051 Although not required in its broadest sense, a method 
consistent with the present invention may further include capturing an image using 
the calibrated image capture device and/or driver and providing a beauty analysis 
based upon the captured image. The beauty analysis may provide information 
regarding an external body condition, as described above. 
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fQ8ff[[01061 A s illustrated in the flow chart of Figure 7, another embodiment 
of the invention may include a method for facilitating a capture of a body part image. 
Consistent with the invention, a method may include instructing a subject to position 
the subject's body part within a field of capture of an image capture device. This is 
graphically illustrated at block 702 of Figure 7. Instructing the subject may include 
providing access to at least one of a client-based algorithm or a server-based 
algorithm for directing the subject. Instructing may be accomplished directly or 
indirectly, using mechanisms previously disclosed. In one example, the "body part" 
could be the subject's face, but the method is not limited to facial imaging. As used 
herein, "field of capture" is intended to include the area adjacent to an image capture 
device where the device is capable of capturing an image. For example, for a web 
cam, the field of capture could relate to the area within the focal view of the web 
cam. 

fQ84-¥01 071 Consistent with the invention, a method may include capturing a 
first image of the subject's body part using the image capture device, as depicted at 
block 704 of Figure 7. "Capturing" a first image may occur directly or indirectly and 
include providing access to at least one of a client-based algorithm and a server- 
based algorithm for causing the image capture device to capture a first image. Also 
consistent with the invention, capturing may include at least one of receiving an 
instruction from the subject to capture a body part image, indicating to the subject 
before a body part image is captured, and indicating to the subject when a body part 
image is captured. "Capturing" may also include providing software to a user so that 
a user may be aided in the capture process. 
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fQ8£¥01 081 Consistent with the invention, a method may include processing 
the first image to thereby calculate at least an approximate first position of the 
subject's body part relative to one or more of the image capture device and a display 
device (e.g., a display device of which an image of the body part is intended to be 
displayed). This is shown at block 706 of Figure 7. The phrase "processing of the 
first image of the subject's body part" may include at least one of determining 
whether the first image includes an entire image of the subject's body part, 
determining whether the first image includes a portion of the subject's body part, 
determining whether the subject's body part is centered in the first image, and 
determining a size of the subject's body part in the first image. The processing may 
be performed using artificial intelligence, including neural networks and fuzzy logic. 
The processing may be accomplished directly or indirectly, using any mechanism 
previously disclosed. 

fQ83Jf0109l Image processing techniques may be employed to extract and 
analyze facial features of the captured image, thereby determining whether an entire 
image of the subject's face has been captured. For example, a computer program 
may extract an outline of a human head and analyze the outline to determine 
whether an entire image of the subject's face has been captured, as illustrated in 
Figures 8a and 8b. Figure 8a depicts an image of a portion of the subject's face 802 
. An outline of the image 804 may be extracted, as shown in Figure 8b. Upon 
analysis of the image using known image processing techniques, such as pattern 
matching, for example, it becomes clear that the outline 804 does not resemble the 
complete outline of a human head. 
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fOS44r01 101 Similarly, a computer program may extract and analyze other 
features of the subject's body part to determine whether an image of the entire face 
has been captured. For example, the computer program may determine whether the 
image includes at least one of a pair of eyes, a mouth, a chin, and a forehead. In 
Figure 8a, image processing techniques may reveal the image 802 does not include 
a mouth or a chin. Thus, the computer program may conclude that the captured 
image depicts only a portion of the subject's body part, and the computer program 
may evaluate a position of the subject relative to the image capture device based on 
the partial image. For example, in Figure 8a, the positioning of the subject's face 
802 indicates that the subject, from the subject's view point, is to the right and 
slightly below the focal plane of the image processing device. 

fQg5¥01111 Similarly, image processing techniques may be employed to 
measure a size of the subject's body part in the captured image. By evaluating a 
size of the subject's body part in the first image, the computer program may 
determine an approximate first position of the subject's body part relative to the 
image capture device. For example, if the subject is positioned too far from the 
image capture device, the subject's facial image might comprise a small area within 
the first image, as shown in Figure 9a. Further, if the subject is positioned too close 
to the image capture device, a portion of the subject's facial image may comprise a 
large area or an entire area of the captured image, as shown in Figure 9b. 

fQ86¥01 1 21 Consistent with the invention, the phrase "processing of the first 
image" also may include determining whether the first image is properly illuminated. 
By determining whether the first image is properly illuminated, the computer program 
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may determine an approximate first position of the subject's body part relative to the 
display device. For example, if upon processing, the first image of the subject's 
body part appears dark, the image processor may instruct the subject to move closer 
to the display device for illumination. Alternatively, if the image is dark, the aperture 
of the image capture device may open to allow more light to pass through. As with 
other aspects of the methods described herein, the processing could involve direct 
or indirect activity. 

fOSTlfO 1 1 31 Consistent with the invention, a method may include comparing 
the calculated first position with a desired reference position, as graphically 
illustrated at block 708 in Figure 7. As shown in Figure 10, a desired reference 
position may include a position D, which is a center of a focal window 1000 located 
at a focal length F L of an image capture device 1002. The focal length F L may 
include a distance at which the image capture device 1002 may focus on an object, 
and a focal window 1000 may include an area, having a width w and a height h, 
captured by the image capture device at the focal length. The computer program 
may approximate the distance the subject needs to move in relation to a known focal 
length of the image capture device and a known size of the focal window. For 
example, in Figure 8a, the computer program may approximate the distance the 
subject must move to position a center of the subject's facial image at the center of 
the focus window 800. One of ordinary skill in the art will readily recognize that the 
focal length and focal window may comprise a range of values. For example, a 
image capture may have a zoom lens, providing an additional focal length and focal 
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window area. Here again, the comparison could involve either direct or indirect 
activity, as described earlier. 

fQS8Jro 1 1 41 Consistent with the invention, a method may include instructing 
the subject to move the subject's body part closer to the desired reference position, 
as graphically illustrated at block 710 of Figure 7. Instructing may include instructing 
the subject about how to move (e.g., the direction and/or amount of movement for 
moving closer to the desired position). Instructing the subject may include directing 
the subject to move when the displacement is greater than the threshold value. In 
this manner, the first image may be accepted and processed if the displacement 
between the approximate first position of the subject's body part and the desired 
reference position is within an acceptable range. "Instructing the subject on how to 
move" may include providing access to at least one of a client-based and a server 
based algorithm for instructing the subject to move. Instruction may be provided in 
the form of text, or in the form of symbols (e.g., arrows depicting direction of 
movement) displayed on the screen. 

f089tf 0 1 1 51 Consistent with the invention, the method may include capturing 
a second image of the subject's body part after the subject has moved the body part, 
as graphically illustrated at block 712 in Figure 7. "Capturing a second image" may 
occur in a manner similar to capturing a first image, which is described above in 
relation to block 704 of Figure 7. 

fQ90tf01161 Although not required in its broadest sense, the invention may 
further include repeating at least portions of method schematically illustrated in 
Figure 7 until the subject is within a threshold value or the number of repeated 
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attempts reaches a maximum number of re-positioning attempts. For example, after 
numerous repositioning attempts, the program may instruct the subject to seek 
technical assistance or may inquire whether the subject wishes to continue the re- 
positioning effort. Alternatively, the re-positioning may halt when the displacement is 
within an acceptable range, defined by the threshold value. 

f0944f01 1 71 A lthough not required in its broadest sense, the method for 
facilitating a capture of a body part image may relate to providing a beauty analysis 
based upon the captured image. The beauty analysis may be similar to the analysis 
described above in reference to an earlier embodiment. 

fQ924r01181 A s illustrated in the flow chart of Figure 1 1 , another embodiment 
of the invention may also include an image capture method. Consistent with the 
invention, the method may include instructing a subject to position a body part 
adjacent the display device and within a field of image capture of an image capture 
device, as graphically illustrated at block 1 102 of Figure 1 1 . The phrase "instructing 
a subject to position a body part" may be performed similar to the instructing of block 
304 in Figure 3, described earlier. The instructions may be arranged to encourage 
the subject to move the body part to a position where the display device might be 
capable of illuminating the body part sufficiently. In one example, the body part may 
be the subject's face, but the method could be practiced for other body parts as well. 

f093¥01191 Consistent with the invention, the method may include sending 
a signal to the display device to generate light in a predetermined wave length range 
for irradiating the body part. This is graphically illustrated at block 1 104 of Figure 1 1 . 
The phrase "sending a signal" may involve providing access to at least one of a 
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client-based algorithm and a server-based algorithm. The sending of a signal may 
be accomplished directly, or indirectly through the provision of software or web 
access that accomplishes the signal function. In addition, indirect accomplishment 
of the sending may occur by partnering or affiliating with a third party who sends the 
signal. 

iQ94Jf0120l Sending a signal may include transmitting a signal that causes 
the light generated by the display device to be within a wave length range that 
effectuates a flash of light from the display device. For example, the display device 
may serve as a flash for a conventional camera, digital camera or webcam. In this 
manner, the method may mitigate poor lighting conditions at an image capture 
location. In addition (or alternatively), the signal might adjust the intensity of the light 
emitted from the display device to thereby alter the amount of illumination of the 
body part. In some instances, the signal might cause the display device to darken 
without generating significant light, for example, to enable multiple images to be 
obtained at differing levels of light illumination. 

fQ95lf012n T he signal may cause the display device to generate light at a 
wave length within a wave length range that includes red light. By transmitting red 
light, the display device may provide red eye reduction and/or enable improved 
visualization of one or more characteristics of the body part. 

fO96J[0122]_A method consistent with the invention may also include 
capturing an image of the body part with the image capture device while the body 
part is irradiated with the light, in the predetermined wave length range, emitted from 
the display device. This is illustrated at block 1 106 in Figure 1 1 . The process of 
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"capturing" an image may be similar to the process described in an earlier 
embodiment. For example, the capturing may be performed directly or indirectly as 
discussed in association with block 306 of Figure 3. The timing of the image capture 
may be such that it occurs simultaneously while the display device illuminates the 
body part with light. 

fQ97l[01231 Although not required in its broadest sense, the image capture 
method may be used for beauty analysis and may further include processing the 
image to derive information about at least one characteristic of the body part. 
Processing may be performed directly or indirectly in any manner described herein. 
The processing may include providing access to a client-based algorithm and/or a 
server- based algorithm. The processing may involve at least partial use of artificial 
intelligence, such as a neural network, for example. The processing may involve 
comparing the captured image to a plurality of images maintained in a database. In 
another example, the method might further include prescribing one or more beauty 
products to the subject as a function of the characteristic(s) of the body part. A 
"characteristic" may include skin tone, skin texture, wrinkles, blood vessels, hair, 
pigmentation, freckles, skin oiliness, and other external body conditions described 
herein. Prescribing may include transmitting a beauty product recommendation to 
be sent to the subject or facilitating such transmission through indirect activity. For 
example, the prescribing could include provided access to a network and/or software 
providing the product recommendation. 

{098J[0124]_lt should be understood that methods in accordance with the 
invention might include at least portions of differing embodiments described herein. 
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For example, the method graphically illustrated in Figure 1 1 may be combined with 
at least portions of the method graphically illustrated in Figure 7, so as to combine 
features of those methods. 

fQ99lf01251 An alternative embodiment of the invention may include a 
combination. Consistent with the invention, the combination may include at least 
one tool for gathering information related to beauty. For example, the tool may be 
configured to gather physical information, physiological information, and/or biological 
information. 

fQ4flQlf01261 T he tool may include one or more of test materials. For 
example, the test material may be pH indicator, sebutape, a d-squame disc, and a 
corneodisque indicator. The subject may use a pH indicator, according to electronic 
or hard-copy instructions, to test a pH value of the skin and/or scalp. Similarly, the 
subject may use sebutape to remove sebum and other lipids from the surface of the 
skin or scalp, thereby indicating skin oiliness. A d-squame disc may be used to 
remove flakes from the surface of the skin or scalp, thereby indicating skin dryness. 
A corneodisque indicator may leech water from the surface of the epidermis, thereby 
indicating the moisture/humidity content of the epidermis. 

r0101i r01271 An example of directions for using sebutape and d-squame 
discs may include instructing the subject to remove the sebutape or d-squame disc 
from a card, place an index finger behind the tape or disc, place the tape or disc 
firmly against the forehead, and remove. The directions may instruct the subject to 
repeat the procedure for the cheek area, using another piece of sebutape. The 
directions may further specify a time for using the materials. For example, the 
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directions may instruct the subject to wait a designated amount of time after 
exercising, washing, or applying any beauty products before performing the test. In 
one embodiment, the directions may instruct the subject to perform the sebutape 
measurements on a forehead, chin, and cheek area at least five hours after washing 
the face and applying no moisturizers, make-up or other beauty product to the skin. 
Directions for the corneodisque indicator and pH indicator may be of a similar 
nature. 

fe4£34f01281 Sebutape, d-squame discs, corneodisque indicators, and pH 
indicators are inexpensive materials that are easy to use and accurately assess skin 
type. Other test materials may include ion detectors, mineral detectors, organic 
detectors, and/or any device capable of measuring a physical, physiological and/or 
biological parameter. By providing such tests, a vendor may remove the guess work 
involved in determining a skin type and provide direct visual evidence to the subject 
for a relatively low cost. Further, the materials may serve as an interactive 
marketing tool to engage the subject, educate the subject, and improve customer 
satisfaction. 

IQ4Q3ir01291 Other tests of varying cost and scope may also be provided. 
For example, the test materials may include a device to measure skin elasticity. 
Similarly, test materials may include hormone tests and enzymatic tests. Test 
materials may also include various color charts (in hard or soft form), which a subject 
may use to compare with an external body condition. For example, the subject may 
use such charts to determine a skin or hair tone, skin or hair color, amount and 
intensity of wrinkles, acne, balding, hairiness, and/or freckles by selecting the chart 
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that most closely represents an external condition of the subject. Similarly, skin 
sensitivity may be measured by comparing a pattern of broken blood vessels or 
capillaries to a chart. The comparison may be completed after applying a particular 
product to the skin to increase effectiveness. In addition, the test materials may 
include materials for the subject to compare with a texture of the skin to determine a 
roughness level of the skin. 

fQ4fl44f0130l Examples of other test materials are disclosed in provisional 
application No. 60/331 ,003, filed on November 6, 2001 , and entitled DISPOSITIF DE 
MESURE ET/OU D'ANALYSE D'AU MOINS UN PARAMETRE D'UNE PORTION 
EXTERNE DU CORPS HUMAIN, the disclosure of which is incorporated herein by 
reference. Such test material may be formed at least partially of ceramic material, 
for example. 

fQ4Q5¥013n A lso consistent with the invention, the test materials may 
include a voucher or other authorization for having one or more tests conducted at a 
testing facility. The directions for conducting the tests performed by a vendor may 
include listing available testing facilities and instructing the subject to redeem the 
voucher at one of the listed testing facilities. As embodied herein, the testing facility 
may use at least one of a corneometer for measuring a water content of subject's 
scalp or skin, a cutometer for measuring skin elasticity, a mexameter for measuring 
a melanin index and hemoglobin (erythema) index of skin, a sebumeter for 
measuring sebum content of scalp or skin, skin-pH meter for measuring pH of skin 
or scalp, skin visiometer for measuring skin roughness, sun protection diagnostic to 
perform an SPF analysis, tewameter to measure trans-epidermal water loss, 
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visioscan to evaluate the skin surface, chromameter to measure skin clarity or 
luminosity, impedance measurements to measure skin moisture, a gas bearing 
electrodynamometer to measure skin softness and suppleness, skin replicas or 
image analysis to measure skin surface smoothness or texture, TEWL to measure 
skin barrier function, laser doppler to measure blood flow or skin sensitivity, 
ultrasound to measure skin and fatty tissue thickness, lesion counting and 
bacteriology to study acne, and ballestometry to measure skin firmness. Hair 
moisture and suppleness, hair tensile strength, penetration of actives into hair, hair 
deposition, and UV protection may also be determined. The tests and test materials 
described above are not intended to be inclusive, it being understood that tests and 
test materials, as used herein, are intended to cover any method and product for 
evaluating an external body condition. 

IQ4Q6¥01321 Also consistent with the invention, the combination may further 
include an image capture device for capturing an image of an external body 
condition of a subject. Consistent with the invention, the combination also may 
include a driver (e.g., software and/or hardware) for driving the image capture device 
to capture a external body condition image of a subject, wherein the image capture 
device, the driver and the at least one tool are packaged and distributed together in 
order to facilitate an electronic beauty analysis. The image capture device may be a 
web camera, digital camera, flat bed scanner, ultra-sound image or any other device 
suitable for image capture. 

fQ4£7J[01331 In an alternative embodiment, the combination may include a 
driver and at least one tool, without the image capture device. For example, the 
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subject may already have a image capture device. A driver may supplement or 
enhance the image capture device the subject already has, or the driver may drive a 
new image capture device. In another embodiment, the combination may include 
the at least one tool, without an image capture device or a driver for driving the 
image capture device. 

fc4£8¥01341 Figure 12 illustrates an example of a combination in the form of 
a customized diagnostic kit. 900. Based on the subject's answers to personal 
questions, one or more of sebutape 902, d-squame discs 904, pH indicators 906, 
and a corneodisque indicator 908 may be selected as a customized set of testing 
materials for the subject, placed in the kit 900, and delivered to the subject. An 
image capture device 910 and a driver 912 for the image capture device may also 
be placed in the kit. The kit 900 may be transmitted to the subject via a courier or 
other delivery means, or picked up by the subject at a designated location. The 
customized kit 900 may include material sufficient to conduct a single test or material 
sufficient to conduct multiple tests. 

fQ4Q9¥01351 A co ponding U.S. appl i cat i on ontit l od Intoract i vo Beauty 
Ana l ysis (attorney docket No. 05725.0977, f il ed on th o samo day as th o present 
applicat i on), incorporated h e re i n by r o ferenc e . A co-pending U.S. application entitled 
Interactive Beauty Analysis (U.S. Patent Application No. 10/024,481) discusses 
further details of the combination, testing material, and kit. 

f01 10i r01 361 As illustrated in Figure 13, features and principles of the present 
invention may be implemented in an exemplary system 1300. System 1300 may 
include a package 1302 containing an image capture device 1304, a computer 1306, 
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network 1308, and mainframe 1310. Components of the system 1300, such as the 
computer 1306 and/or the mainframe 1308, could be configured and/or loaded with 
software to perform some or all of one or more of the steps of the methods 
described herein. 

f01 1 1i r01371 Of course, as a person of ordinary skill in the art will appreciate, 
system 1300 is one of many systems capable of implementing features and 
principles of the invention. For example, the methods may be performed wholly by 
computer 1306 and/or the mainframe 1310, without the network 1308. In another 
example, the computer 1306 may be a kiosk located in a retail space. Accordingly, it 
should be appreciated that the system 1300 and the above-mentioned examples are 
exemplary and not intended to limit the scope of the invention. 

{Q44gir01381 Various embodiments herein employ similar terminology. For 
expert review, the same or similar terms are not necessarily redefined fully with the 
presentation of each additional embodiment. It is nevertheless to be understood that 
defined terms and concepts apply equally to all embodiments. 

fO443l[01391 T his application may discuss beauty products in connection with 
use by women. However, it is to be understood that such discussions are for 
exemplary purposes only. It is to be understood that the invention is equally 
applicable to all genders, and is not necessarily limited to the beauty industry. It is 
also to be understood that any functional aspect of the invention can be 
implemented via any location in the system or network, and data software may be 
resident at any location either in a network, at a stand-alone site, or on media in the 
custody and control of a user or subject. 
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r01*H1 f01401 It is to be further understood that the physical mechanisms (e.g. 
hardware, software, networks, systems) for implementing the methods of the 
invention are many. Networks, hardware and systems can be configured in a host of 
ways with software and hardware functionality residing at many alternative locations. 
In addition, systems other than the exemplary systems disclosed might be used to 
implement the invention. Therefore, it is to be understood that the methods of the 
invention are not limited to any particular structure. 

fQ445if014n Further, methods or portions thereof can be implemented in 
either an electronic environment, a physical environment, or combinations thereof. 
Thus, for example, although one or more portions of a method may occur in an 
electronic environment, a "purchase" portion of the method may occur in a brick and 
mortar store, or vice versa. 

Cross - r e f e r e nc e to Concurrontlv Fil e d Applications and Global D e f i n i tions 

[01 16]This application claims pr i or i ty on and incorporates by reference tho 
following U.S. Prov i sional appl i cations: Art i f i c i a l I nte lli gence For Uso In Cosmotic 
And Non - Cosmotic Environments, App li cation No. 60/325,561 (prov i sional filod 
10/01/01); and Methods And Syst e ms For Cosmotic And Non - Cosmot i c Product 
So l oct i on, Appl i cat i on No. 60/325,559 (prov i sional fi l od 10/1/01). 

[0117]Tho following concurr e ntly f il od U.S. pat e nt app li cations ar o also 
i ncorporated horoin by roforonco: Body Imago Enhancomont, Attorney Docket No. 
05725.0972; Methods And Systems For Pr e dict i ng And/O r T ra c king Changes I n 
Externa l Body Cond i tions, Attorney Docket No. 05725.0973; Methods And Systems 
For Generating A Prognosis, Attorney Docket No. 05725.0974; Histor i ca l Beauty 



55 



Marked-Up Copy of Substitute Specification 

Rocord, Attornoy Dockot No. 05725.0975; Identif i cation And Procontation Of 
Ana l ogous Boauty Caso H i stor i os, Attornoy Docket No. 05725.0976; I ntoractivo 
Boauty Ana l ysis, Attornoy Dockot No. 05725.0977; Foature Extraction In Beauty 
Analysis, Attornoy Dockot No. 05725.0978; Simulat i on Of An Aosthot i c Foaturo On 
A Facia l I mago, Attornoy Dockot No. 05725.0979; Boauty Advisory Systom And 
Method, Attornoy Dockot No. 05725.0980; Virtual Boauty Consultant, Attornoy 
Dockot No. 05725.0981; Calibrat i ng Imago Capturing, Attornoy Dockot No. 
05725.0982; Uso Of Art i ficial I nte l l i gence I n Provid i ng Boauty Advice, Attorney 
Dock o t No. 0572.0983; Shop -l n - Shop Website Construction, Attorney Dockot No. 
05725.098^1; Early Dotoct i on Of Boauty Troatmont Progress, Attorney Dockot No. 
05725.0985; Cosmet i c Affin i ty Indexing, Attornoy Dockot No. 05725.0986; Systems 
And Methods For Provid i ng Boauty Guidance, Attorney Dockot No. 05725.0987; 
Methods And Systems I nvolving S i mu l ated Appl i cat i on Of Boauty Products, Attornoy 
Dockot No. 05725.1008; Customized Boauty Tracking Kit, Attorney Dockot No. 
05725.1009; Analys i s Using Throo - Dimonsional Fac i a l Imago Attornoy Dockot No. 
05725.1010; Body I mago Temp l ates With Pro - Appl i ed Boauty Products, Attornoy 
Dockot No. 05725.1011. 

[01 18]To the extent not incons i stent with the i nvent i on defined heroin, 
d e f i n i t i ons and t e rminology usag e i n th e above - mentioned concurrently f ile d 
appl i cations, tho abovo - ment i oned priority applications, and the fo l low i ng globa l 
d e fin i tions aro to bo cons i dorod i n interpret i ng th e l anguag e of this patent and the 
c l a i ms heroin. Whoro multip l e def i nit i ons am provided, they should bo cons i dered 
as a s i ngle cumulat i ve defin i tion. 
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[01 19]Tho torm "imago" may includo ono or moro of two - dimons i onal and 
three - d i mensiona l repres e ntat i ons. I n certa i n examp l es cons i st e nt with tho 
i nvent i on, a p l ural i ty of i mag e s from d i fferent perspect i ves may bo usod to construct 
a thre e- d i m e nsiona l i mag e . I n a broador s e ns e , on l y a singl e imag e may b e us e d. 
Depend i ng on tho embod i ment, tho torm " i mago" may i ncludo e i ther a v i sua ll y 
p e rc e ptib l e i mag e or electronic i mag e data that may b e e ith e r us e d to construct a 
visually porcopt i blo i mago or to dorivo i nformation about tho subject. Tho i mago 
may bo a body i mago correspond i ng to an anatomical portion of tho subject, and 
may roprosont, for oxamplo, tho subject's ontiro face, or a port i on of tho subject's 
fac e . Th e i mago may b e a d e tai l ed picture (e.g., a dig i ta l i mag e or a photograph) of 
a portion of tho subject's body and/or a topologica l plot mapp i ng contours of a 
port i on of subject's body. I f tho imago i s roprosontativo of an external body 
cond i t i on, th e imag e cou l d b e e i th e r an actua l i mag e showing th e cond i t i on or an 
imago i nclud i ng symbol i zations of tho cond i t i on, for oxamp l o. Tho imago may bo an 
actua l or a s i mu l ated i mago. S i mulated i magos may i nc l udo wholly or partially 
generated computer images, images based on ex i sting imagos, and i mages based 
on stor e d f e atur e s of a subject. 

[0120]Tho torm " i mago capture dev i ce", simi l ar terms, and torms roprosonting 
structures with s i m i lar functions may includo one or mor e of a dig i tal cam e ra, 
webcam, f i lm camera, analog camera, dig i ta l video camera, scanner, facsimile 
machin e , copy machin e , i nfrared i magor, ultra - sound imag i ng device, or any oth e r 
mechan i sm for acquir i ng an i mago of a subject's externa l body cond i t i on, an i mago 
of tho subject's countenance, an/or an i mago of tho subject's skin. An ultrasonic 
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dovico m i ght provide skin thicknoss information, or i t m i ght croato a map on an aroa 
of th e e xt e rnal locat i on. Thus, tho torm " i mage" as usod here i n may be broador than 
a p i cture Comb i nations of imago capturo dovicos may bo used. For oxamplo, an 
imago captured on photographic papor using a f i lm camera m i ght thon bo scanned 
on a flat bed scann e r to create another imag e . 

[0121]Tho torm "capturing (an i mago)", or any form thoroof, rofors to tho use 
of an imag e captur e d e v i c e to acqu i r e an image. "Captur i ng" may roferto the dir e ct 
act of us i ng th e imago capture device to acqu i r e tho imago. It may a l so i nc l ud e 
i ndirect acts to promote acqu i sition. To this ond, "captur i ng" may includo tho ind i rect 
acts of prov i ding acc e ss to hardware, or to at l e ast on e of a o li ont - bas e d a l gorithm 
and a s e rv e r - bas e d a l gorithm for caus i ng tho i mage captur e d e vice to captur e an 
image. This may b e accomp li sh e d by providing a us e r w i th softwar e to aid in th e 
imag e capture process, or prov i ding th e user with access to a n e twork l ocation at 
which th e software r e sid e s. A l so cons i st e nt w i th certa i n embod i m e nts of th e 
inv e nt i on, captur i ng may includ e at l e ast on e of r e ceiving an instruction from th e 
subj e ct to captur e an i mage, i nd i cating to th e subject boforo the i mag e is captured, 
and i nd i cat i ng to th e subj e ct when tho image i s captured. 

[0122]Tho torm " i mago processing tochn i quo" or s i m i lar torms, may i ncludo a 
software program, computer, application specif i c intogratod circuit, o l octron i c d o vic o 
and/or a processor d e sign e d to id e ntify in an i mage on e or moro charact e rist i cs, 
such as a sk i n condit i on. Such techn i ques may invo l ve b i nar i zation, i mag e 
part i t i oning, Fouri e r transforms, fast Fourier transforms (FFTs), and/or discr e t e 
cosino transforms may bo performed on all or part of tho imago, result i ng in 



58 



Marked-Up Copy of Substitute Specification 

coofficiontc. Based on tho coeffic i ents, conditions may bo l ocated, as known i n tho 
art. Art i f i cial into ll igonco, such as fuzzy log i c, noura l networks, gonot i c programm i ng 
and decision tree programm i ng, may also bo usod to i dontify cond i tions. 
A l tornat i voly, one or more digital f il ters may bo passed through tho i mago for 
l ocat i ng specific conditions. Th o s e o xamp l os are provided for i l lustrat i ve purposes 
w i th th e und e rstand i ng that any imag e process i ng t e chniqu e may b e us e d. 

[0123]Tho term "network i nterface" or s i milar torms, refer to any mochanism 
for aiding commun i cat i ons betwe e n various nodes or l ocat i ons i n a n e twork. A 
notwork i ntorfaco may i nc l ude, for examp l e a bus, a modem, or any other 
input/output structur e . A n e twork interfac e may p e rmit a conn e ction to any network 
capab l e of b e ing conn e ct e d to an input and/or output module locat e d within at l east 
one or moro of tho follow i ng exemplary networks: an Ethornot notwork, an Internet 
Protocol notwork, a to l ophono notwork, a rad i o notwork, a ce ll ular notwork, or any 
mochanism for permitting commun i cation between two or moro modes or remote 
locat i ons. I n some invent i on embodiments, a notwork intorfaco might also i ncluded 
a us e r i nterface. 

[012 ^1 ]Th o term "us e r intorfaco" may i nclude at least ono compon e nt such as 
a k e yboard, k e y pad, mouse, track ball, te l ephon e , scanner, m i crophono, touch 
scr ee n, web cam, i nteractive voic e r e spons e syst e m (1VR), voice recognition syst e m 
or any oth e r suitab le i nput m e chanism for convey i ng i nformat i on. A us e r i nt e rfac e 
may a l so inc l ud e an input port connected by a wired, opt i ca l , or wir e l e ss connection 
for e l ectromagnet i c transm i ss i ons. I n some ombodimonts, a user i ntorfaco may 
i nc l ud e conn e ct i ons to oth e r comput e r systems to rec e iv e th e input commands and 
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data therefrom. Usor intorfaco may further i ncludo a data road i ng dov i co cuch ac a 
dick drivo for r e c ei ving i nput data from and writing data to storage mod i a such as 
magnetic and opt i cal disks. 

[0125]As usod horoin torms such ao "oxtornal body condit i on", "skin 
condition", and "actua l condit i on" rofor to condit i ons of at loast ono of tho sk i n, tooth, 
hair, oyobrows, oyolachos, body ha i r, fac i al hair, f i ngerna i ls, and/or toenai l s, or any 
other externa l ity. Examples of sk i n conditions may inc l udo elast i city, dryness, 
ce l lu l itis, sweating, ag i ng, wrink l es, melanoma, exfol i at i on, desquamat i on, 
homog e ne i ty of co l or, cr e ases, liver spots, c l arity, l inos, micro - circulat i on, shininoss, 
softness, smoothness, tone, texture, matitty, hydration, sag, supp l eness, stress, 
springiness, f i rmness, sobum product i on, c l oanlinoss, transluconcy, lum i nosity, 
irritation, redness, vasoco l ation, vasomotion, vasodilation, vasoconstr i ction, 
p i gmentation, freck l es, blem i shes, oilinoss, pore distribution, pore sizo, molos, 
b i rthmarks, acn e , blackh e ads, whiteheads, pockmarks, warts, pustules, boi l s, 
blisters, marks, smudges, specks, psoriasis and other characteristics assoc i ated 
with tho subject's skin. Examples of hair condit i ons may i ncludo keratin p l ug, l e ngth, 
dryness, oilin o ss, dandruff, pigm e ntat i on, thickness, density, root conditions, spl i t 
ends, hair loss, ha i r thinning, sca l es, staging, cloan l inoss and other properties 
r e lated to tho subject's hair. Examp l es of fingerna i l and to e nai l condit i ons may 
includ e onychomycosis, sp li t na il s, d e laminating, psorias i s, bri ll iancy, l ines, spots, 
co l oration, g l oss, strength, brittlonoss, thickn e ss, hangnai l , le ngth, disease, and 
other characteristics re l ated to tho subject's na i ls. Other cond i t i ons may includo, for 
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example, o i zo and proport i on of facia l foaturos, tooth disco l orat i on, and any othor 
aesthetic - r el at e d or phys i ca l , phys i o l og i ca l , or bio l ogica l cond i tions of tho user. 

[0126]"Enab l ing", "facilitating", and "causing" an action rofor to ono or moro of 
a d i rect act of performing tho action, and any ind i rect act of encouraging or boing an 
accessory to tho action. Thus, tho torms inc l ude partner i ng or cooperating w i th an 
ent i ty who porforms tho action and/or referr i ng commorco to or hav i ng commerce 
referred from an ent i ty who perform s th o act i on. Othor examp l es of indirect activity 
encompass e d w i thin th e d e f i nitions of " e nab li ng", "faci li tating", and "causing" may 
i nclud e providing a subj e ct w i th ono or more of too l s to knowingly a i d in perform i ng 
tho action, prov i d i ng instruct i ons on how to perform tho act i on, prov i d i ng prompts or 
cues to p e rform th e act i on, or expr e ssly encourag i ng p e rformanc e of tho action. 
I ndir e ct act i vity may also include coop e rat i ng with an e ntity who either directly 
performs th e action or who h e lps anoth er p e rform the act i on. Tools may includ e 
softwar e , hardwar e , or acc e ss ( e ith e r d i rect l y, through hyp e rlink, or some other typ e 
of cooperation or partn e ring) to a n e twork locat i on (e.g., web s i te) prov i ding too l s to 
aid in perform i ng th e act i on. Thus, phras e s such as "enabling access" and "onabl i ng 
display" do not necessary requ i re that tho actor actual l y acc e ss or d i splay anything. 
For examp le , th e actor may p e rform th e e nabl i ng function by aff ili ating with an entity 
who porforms the action, or by prov i d i ng i nstruct i ons, tools, or encouragomont for 
another to do tho accessing and d i splaying. 

[0127]Forms of the word "displaying" and l ike t e rms may a l so i nc l ude indir e ct 
acts such as prov i ding content for transm i ss i on over a network to a d i sp l ay device, 
regardl e ss of wh e th e r tho display device i s in th e custody or contro l of th e s e nd e r. 
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Any ent i ty in a chain of dolivor i ng i nformat i on for d i sp l ay porforms an act of 
"d i sp l aying", as th e term is used h e r ei n. 

[0128]Likewiso, tho term "providing" includos direct and indirect activ i ties. For 
examp le , prov i d i ng acc e ss to a comput e r program may includ e at least on e of 
providing access ovor a network to tho computer program, and croating or 
d i stribut i ng to tho subject a computer program configured to run on tho subject's 
workstation or computer. For oxamplo, a f i rst party may d i roct network traffic to 
(eith e r through el e ctronic l i nks or through encouragement to vis i t) a server or w e b 
s i t e run by a s e cond party. — I f th e se cond party maintains a part i cu l ar p i oco of 
software thoroon, then i t i s to bo understood that w i th i n tho moaning of "providing 
access" as used heroin, tho first party is sa i d to provide access to tho particular 
software. Or if tho f i rst party d i rects a subject to a second party who in turn ships tho 
part i cular software to the us e r, th e f i rst party is said to provide th e us e r w i th acc e ss 
to th e part i cu l ar software. (Of course, i n both of the abovo instanc e s, tho second 
party would also b e providing acc e ss w i thin the m e aning of the phras e as us e d 
heroin.) "Receiving" may include at least one of acquis i tion via a network, via 
verba ll y communication, via electronic transmission, v i a te l ephone transmission, in 
hard - copy form, or through any other mechanism enabl i ng recept i on. In addition, 
"receiving" may occur either dir e ctly or ind i rect l y. For e xample, rec ei pt may occur 
through a third party acting on another party's behalf, as an agent of another, or in 
conc e rt w i th anoth e r. Regard l ess, a l l such ind i r e ct and d i rect actions are i ntend e d to 
bo covered by tho term "receiving" as used heroin. A rece i ved request, for oxamplo, 
may tak e ono of many forms. It may simp l y be a ch e ck e d box, click e d button, 
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Gubm i ttod form or oral affirmation. Or it might bo a typod or handwritten textual 
request. Rec e iv i ng may occur through an on - lino i nterest form, e- mai l , facs i mil e , 
tolophono, i ntoract i vo voico response system, or f il o transfer protocol trancm i ttod 
e l e ctron i ca l ly ov e r a n e twork at a web s i te, an internet protocol address, or a 
network account. A roquost may bo roco i vod from a subjoct for whom information is 
sought, or an ent i ty acting on the subject's behalf. "Rece i v i ng" may invo l vo receipt 
d i rect l y or i nd i r e ct l y through one or more networks and/or storag e m e diums. Rec e ipt 
may occur physically such as in hard copy form, via ma i l deliv e ry or othor cour ie r 
d el iv e ry. 

[0129]Forms of tho word "ma i nta i n" aro used broad l y to include gathering, 
stor i ng, acc e ssing, provid i ng access to, or mak i ng something avai l able for acc e ss, 
oithor d i rectly or i nd i rectly. For oxamplo, thoso who maintain i nformation i nclude 
ent i t ie s who provid e a l i nk to a s i to of a third party whoro the information is stor e d. 

[0130]Consistont with tho concepts sot forth above, all othor recited actions 
such as, for o xampl o , obtaining, dotormining, gonorating, se l ecting, applying, 
simulating, presenting, e tc, ar e inclusiv e of dir e ct and i ndir e ct actions. Thus, for 
purposes of interpr e t i ng the fo ll ow i ng claims, an entity performs a rocitod action 
through either dir e ct or i ndirect activity. Furth e r examples of indirect activity i nclude 
sending signals, provid i ng softwar e , prov i d i ng i nstructions, coop e rating with an e ntity 
to have tho entity perform tho action, outsourcing d i rect or i nd i rect act i ons, or serv i ng 
in any way as an accessory to the specif i ed act i on. 

[0131]Tho torm "product" i s usod to gonor i cally rofor to tang i ble morchandiso, 
goods, services, and actions p e rformed. A "beauty product," "boauty care product," 
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"cosmetic product" or s i milar terms, rofor to products (as dofinod abovo) for offocting 
on e or more ext e rnal body condit i ons, such as condit i ons of th e sk i n, ha i r and na i ls. 
Examp l es of tangib l e morchand i so forms of boauty products i nc l udo cosmet i c 
goods, such as treatment products, personal cleansing products, and makeup 
products, in any form (e.g., o i ntments, creams, gols, sprays, supplement, i ngosta, 
i nha l ants, lot i ons, cak e s, l iquids, and powders.) 

[0132]Examp l os of services forms of boauty products includo hair sty li ng, ha i r 
cutt i ng, ha i r co l or i ng, ha i r r e moval, skin tr e atm e nt, mak e- up applicat i on, and any 
other offering for aesthet i c enhancement. Examp l es of other actions performed 
i nclude massages, facial rubs, deep c l oansings, app l icat i ons of boauty product, 
o x o rc i s o , therapy, or any other action offoct i ng the external body cond i tion whether 
performed by a profess i onal, tho subject, or an acquaintance of tho subject. 

[0133]Tho fol l ow i ng is exemplary and non - exhaust i ve listing of a fow b o auty 
products - scrubs, r i nses, washes, moistur i zers, wrinkle removers, exfol i ates, tonors, 
c l eansers, cond i t i oners, shampoos, cuticlo creams, oi l s, and anti - fungal substances, 
anti - aging products, ant i- wr i nk l e products, anti - fr e ckl e products, skin cond i tion e rs, 
sk i n toners, skin co l or i ng ag e nts, tanners, bronzors, sk i n light o nors, hair coloring, 
hair c le ansing, ha i r styl i ng, e l asticity enhancing products, agents, b l ushes, 
mascaras, e y e l i n e rs, li p liners, l i pst i cks, lip gloss e s, e y e brow l i ners, e y e shadows, 
nail pol i shes, foundations, concealers, dontal wh i tening products, collu l ito reduction 
products, hair stra i ght o n o rs and cur lers , and weight reduct i on products. A boauty 
care treatment regimen may involve tho adm i nistration of one or moro products, as 
d e fined above. 
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[0134]Tho tormo "boauty adv i co", "boauty gu i danco", and similar torms aro 
used i ntorchangoably to rofor to tho provision of boauty rolatod information to a 
subject. Advico or guidanco includes ono or more of boauty product 
rocommondations (e.g., cosmetic product rocommondat i ons for products to treat 
cond i t i ons tho subjoct is promptod to evaluate), remed i al measures, provontat i vo 
measures, predict i ons, prognoses, prico and availab ili ty informat i on, applicat i on and 
us e i nformation, sugg e st i ons for complem e ntary products, l ifestyle or d i etary 
recommendat i ons, or any oth e r informat i on intended to a i d a subj e ct in a cours e of 
future conduct, to a i d a subject in und e rstanding past occurrenc e s, to r e f l ect 
information about some future occurrences rolatod to tho subject's beauty or to aid a 
subject in understand i ng b e auty products, a s d e fined above. 

[0135]Tho term "network" may include a public network such as tho Internet 
or a telephony network, a pr i vate network, a virtua l private network, or any other 
mechanism for e nab li ng communication betw ee n two or more nod e s or locations. 
The network may include ono or more of wired and wireless connect i ons. Wire l ess 
communicat i ons may include rad i o transmission v i a th e a i rwaves, however, those of 
ordinary skill in tho art will apprec i ate that various oth e r commun i cation tochn i quos 
can bo used to prov i de wireless transmiss i on i nclud i ng infrarod li no of sight, cellular, 
microwav e , sat el l i t e , blue - tooth pack e t rad i o and spr e ad sp e ctrum rad i o. W i r e l e ss 
data may inc l ude, but i s not limited to, paging, text messaging, e - mail, I nternet 
access and othor sp e c ial iz e d data applicat i ons spec i f i ca l ly e xc l uding or i nclud i ng 
voice transmission. 
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[0136] l n somo instances consistent w i th tho invont i on, a network may i nc l udo 
a courior network (e.g. posta l service, United Parce l Service, Fodora l Express, etc.). 
Othor typos of notworks that are to bo considered within tho scopo of tho invontion 
includo local aroa networks, metropo li tan area networks, w i do area networks, ad hoc 
networks, or any m e chanism for fac il itating commun i cation between two nod e s or 
remote locations. 

[0137]"Artific i a l intol l igonco" (A l ) is usod hero i n to broadly doscribo any 
computational l y inte lli gent systems that comb i no knowledge, tochniquos, and 
m e thodo l ogies. An A l engin e may b e any system configur e d to app l y knowl e dge 
and that can adapt i tself and loarn to do bettor i n chang i ng env i ronments. Thus, the 
A l engine may e mploy any on e or combination of th e fo l lowing computationa l 
tochniquos: noural network, constraint program, fuzzy logic, c l assificat i on, 
convent i ona l artificia l into lli gonco, symbol i c manipulat i on, fuzzy sot theory, 
evo l utionary computation, cybornotics, data m i ning, approximate reason i ng, 
dorivativo - froo opt i m i zation, decision troos, or soft comput i ng. Employing any 
computationally i ntel li gent tochniquos, tho A l engine may l oarn to adapt to unknown 
or changing e nvironment for better performanc e . Al e ng i nes may b e imp l ement e d or 
prov i ded w i th a wid e vari e ty of compon e nts or systems, i nclud i ng on e or more of th e 
following: centra l process i ng un i ts, co - proc e ssors, memories, reg i sters, or other 
data processing devices and subsystems. 

[0138]AI engines may bo tra i ned based on i nput such as product informat i on, 
export advico, user prof il e, or data basod on sensory perceptions. Us i ng i nput an Al 
eng i ne may impl e m e nt an it e rativ e tra i n i ng process. Tra i ning may be based on a 
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wido variety of l earning ru l es or tra i n i ng a l gorithms. For oxamp l o, tho loarn i ng ru l es 
may i ncludo one or moro of tho fo l low i ng: back propagat i on, rea l- time recurrent 
l oarn i ng, pattorn - by - pattorn loarning, suporvisod l oarn i ng, i nterpo l ation, wo i ghtod 
sum, reinforced loarn i ng, tempora l difference l oarn i ng, unsuperv i sed l oarning, or 
rocord i ng l oarn i ng. As a resu l t of tho tra i n i ng, Al ongino may learn to mod i fy its 
behav i or i n r e spons e to i ts e nv i ronm e nt, and obtain knowledge. Knowl e dg e may 
r e pres e nt any i nformation upon wh i ch A l ong i no may d e t e rm i ne an appropr i at e 
response to now data or situat i ons. Knowlodgo may represent, for oxamplo, 
re l ationship informat i on between two or moro products. Know l edge may bo stored 
in any form at any conv e ni e nt l ocation, such as a database. 

[0139]Sinc e A l e ng i n e may l e arn to mod i fy i ts b e hav i or, informat i on 
describing re l ationships for a univ e rs e of a l l comb i nations of products may not nood 
to bo maintained by tho A l ongino or any other componont of tho system. 

[0140]"Porsonal informat i on", "subject spoc i f i c information", "usor specific 
i nformation", "user profile", "personal characterist i cs", "persona l attr i butes", "profi l e 
information", and like torms (collectively roforrod to in th i s sect i on as "persona l 
i nformation") may broadly e ncompass any i nformat i on about the subj e ct or user. 
Such i nformation may, for example, fall within categories such as physical 
characterist i cs, fash i on prefer e nces, demographics, nutritional information, cosm e t i c 
usag e informat i on, medica l history i nformation, e nv i ronmenta l informat i on, b e auty 
product usag e i nformat i on, lifesty l e, and may i nc l ude i nformat i on such as nam e ; 
ago; b i rth dato; height; weight; othnicity; eating hab i ts; vacation patterns; geograph i c 
locat i on of tho i ndiv i dual's residence, l ocation, or work; work hab i ts; sl ee p habits; 
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toi l otrioo ugocI; oxorciso habits; rolaxation habitc; boauty caro habits; smoking and 
drink i ng habits; sun oxposuro habits; uso of cunocroon; propens i ty to tan; numbor of 
sunburns and s e rious sunburns; d ie tary rostrictions; dietary suppl e ments or vitam i ns 
used; d i agnosed cond i t i ons affecting tho oxtorna l body, such as m el anoma; an 
imago, such as a p i cturo or a multimod i a fi l o of tho subject; facial f o aturo 
charactor i stics; fam il y history i nformation such as phys i cal charactoristics 
i nformation about ro l ativos of tho subjoct (e.g., premature ba l ding, graying, wr i nkles, 
etc.); external body condition (as dofinod previously); co l or proforoncos, clothing 
stylo preferences, trave l habits; entertainment proforoncos; fitness informat i on; 
adverse react i ons to products, compounds, or e l ements (o.g., sun oxposuro); body 
chemistry, uso of pr i or boauty caro products and their effectiveness; purchasing, 
shopping, and browsing habits; hobbies; mar i ta l status; whether tho subjoct is a 
parent; country of ros i donco; region of rosidonco; birth country and region; re l ig i ous 
aff ili ation; pol i t i ca l affil i at i on; whether tho subjoct is an urban dweller suburban 
dwe l ler or rural aroa dwollor; s i zo of urban area in which tho subjoct l ives; whether 
tho subjoct is ret i red; annual income, sexua l proforonco, or any other informat i on 
r e fl e ct i ng habits, prof o r o ncos, or affi l iat i ons of th e subjoct. 

[0141 Persona l information may also include i nformation electron i ca l ly 
gleaned by tracking tho subject's electron i c brows i ng or purchasing habits, or as the 
result of cook i os ma i ntained on tho subject's computer, rosponsos to surveys, or any 
other mechan i sm providing information re l ated to th o subjoct. I n add i tion, persona l 
informat i on may bo gathered through non - electron i c mechan i sms such as hard copy 
surveys, p e rsona l interv i ews, or consumer pr o for o nco po ll s. 
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[0142]"Complomontary" and "complementary product" rofors to ono or moro 
of physical, phys i o l ogical, bio l og i cal l y, and aesth e t i c compat i bi l ity. A product may be 
complementary w i th ono or moro of another product, a group of products, or a 
subj e ct. — I n that l att e r i nstance, whether a product is consid e red "complementary" 
may bo a function of persona l information of the subject. Thus, for examp l e a 
product may bo complem e ntary if it is un l ik el y to causo an adverse allerg i c react i on; 
i f i t physica ll y blonds well with another product; or i f it is aesthetical l y consistent with 
tho subject or ono or moro other products. Aesthet i c compat i bly may rofor to th e 
fact that two products aro aesthetica ll y appealing (or do not c l ash) whon worn 
together. The id e nt i f i cat i on of a comp le m e ntary product may also be bas e d on 
product characteristics, usor proforoncos, survey data, or export adv i ce. 

[01 13]As usod herein, tho words "may" and "may bo" aro to bo i ntorprotod in 
an opon - ondod, non - rostr i ctivo manner. At m i nimum, "may" and "may bo" aro to bo 
intorprotod as dofin i t i vo l y i nclud i ng structuro or acts rocitod. Further, tho word "or" is 
to bo intorprotod in tho conjunctive and tho disjunctive 

f04444[01421 While flow charts presented herein illustrate a series of 
sequential blocks for exemplary purposes, the order of blocks is not critical to the 
invention in its broadest sense. Further, blocks may be omitted and others added 
without departing from the spirit of the invention. Also, the invention may include 
combinations of features described in connection with differing embodiments. 

fQ4-45¥01431 A lthough a focus of the disclosure may be on server-side 
methods, it is nevertheless to be understood that the invention includes 
corresponding client-side methods, software, articles of manufacture, and computer 
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readable media, and that computer readable media can be used to store instructions 
for some or all of the methods described herein. Further, it is to be understood that 
disclosed structures define means for implementing the functionality described 
herein, and that the invention includes such means for performing the disclosed 
functions. 

[01461 1*01441 In the foregoing Description of Exemplary Embodiments, 
various features are grouped together in a single embodiment for purposes of 
streamlining the disclosure. This method of disclosure is not to be interpreted as 
reflecting an intention that the claimed invention requires more features than are 
expressly recited in each claim. Rather, as the following claims reflect, inventive 
aspects lie in less than all features of a single foregoing disclosed embodiment. 
Thus, the following claims are hereby incorporated into this Description of the 
Exemplary Embodiments, with each claim standing on its own as a separate 
embodiment of the invention. 
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